Download the authoritative guide: Enterprise Data Storage 2018: Optimizing Your Storage Infrastructure
It is that time of year again when we look back to see where we've been and look forward to see where the storage industry is going. Every year, I try to predict technology winners, losers and those stuck in the middle.
Both 2010 and 2011 saw significant stagnation in the storage industry, but in my opinion, 2012 was a breakout year. I expect that, unless something bad happens to the economy, 2013 will continue with that trend.
"Consolidation" is going to be next year's buzz word. Large vendors are flush with cash and the folks in the investment community are applying significant pressure for growth and profits.
So how well did I do with my 2012 predictions?
- I said that declustered RAID would be available from most major vendors, a prediction I based on 4 TB drives becoming mainstream. Though some vendors do have 4 TB drives, not all of them do. Some vendors, such as NetApp and IBM, do offer declustered RAID, but it surely is not ubiquitous in the industry.
- I also predicted that SSDs would achieve 2,000,000 IOPS performance. I got this one right, but not until October. I am not saying in any way, shape or form that doing 2 million IOPS is useful, but the SSD IOPS arms race will continue no matter what I think.
- In addition, I said that SAS RAID/JBOD cards would hit 1.2 million IOPs by the end of 2012 because these faster cards are needed for SSD RAID devices. Well, I was off by a little. Back in September, an LSI press release announced a single 8-port 12Gb/s SAS ROC IC achieving over 1.2 million IOPS (I/O operations per second) and said that “Volume shipments of 12Gb/s SAS-enabled servers is estimated to occur by early 2013, followed by the availability of external storage systems by mid-to-late 2013.” So I missed this one by a few months. Darn.
- I predicted that the appliance market would grow significantly for everything from home PCs to large enterprises to HPCs. I believed there would be significant growth in this area given that low-end CPUs were getting cheaper and faster. I do not think that anyone can argue about the growth in this market from big data, NAS, archive appliances, etc. The market for simplified storage is growing and growing at a high rate.
- Also, I forecast that in 2012 there would be significant improvements in parallel file system performance for metadata scaling data. This is happening for sure with new appliances from IBM with GPFS and appliances from DDN, NetApp, Xyratex and others for Lustre. This is a large growth market because everyone wants a large common namespace and current NAS products are not meeting the challenge.
- I predicted that SSD marketing consolidation would continue. I do not think that anyone can argue this is not happening. Texas Memory becoming part of IBM is just one example.
- Next, I said that enterprise SSDs density would grow at best by 50 percent for 2.5 inch drives. Last year we had 600 GB enterprise SSDs at the top end. Today, we have 800 GB enterprise SSDs at the top end for 33 percent growth.
- I also stated that 16 Gbit Fibre Channel would be released long before the end of 2012. But I said the per-port cost for an HBA and switch ports for, say, a 16-port switch would be more than four times the cost of 10 GbE ports. The cost of 10GbE ports would drop quickly, given that the volume is dramatically increasing. All of this happened exactly how I thought it would. Both QLogic and Emulex released 16 Gb Fibre Channel. 10 GbE ports are finally starting to drop in price, and the cost of a NIC is just tens of dollars.
- In addition, I predicted that cloud storage would continue to have problems, and I forecast additional data losses or non-availability (e.g., data would need to be restored from tape) from at least one major provider. How many outages did we have this year? Azure, Amazon, Google and others all reported downtime.
- Finally, I said that LTFS (linear tape file system) products would be released into the market by more vendors and that this would allow tapes to be shipped around the world without requiring backup or HSM applications to read the data. Today, we have products in the market from Crossroads, IBM, HP, Oracle and others. LTFS has moved to SNIA for standardization, and proprietary tape formats are being seriously threatened.
Results: My final tally for 2012 was 8 correct and 2 wrong, with 1 of those 2 being delayed till early 2013.