Download the authoritative guide: Enterprise Data Storage 2018: Optimizing Your Storage Infrastructure
Catchy title, right? Here's where it came from?
A few times a year, the editorial team and I have a conference call to discuss future articles, brainstorm ideas and try to address industry trends. A few months ago we had such a call and I was ranting about a variety of topics that I was dealing with from customers and vendors. Many of the things I was ranting about I had dealt with more than 20 years ago. Dan Muse, Internet.com's editor in chief, was on the call and asked regarding one of the topics, "haven't we evolved beyond that?" A two-part article was born.
It continues to amaze me that we repeat the same errors over and over again. Stupid might not be the best word -- or a fair term -- but I do love to rant. As George Santayana said, "Those who cannot remember the past are condemned to repeat it." This time I want to look at some of the evolution of thought, or lack thereof, on storage and storage technology. Why do we want to believe this stuff?
Time Machine: 1991
For those of you who do not remember, or are not old enough to remember, when Seagate introduced its first SCSI drive it had .5 GB of storage capacity. It could read and write about 4 MB/sec and the drive had a seek time of 14 ms and latency time of 6.80 ms. Really nice technology for 1991. Late that year Seagate introduced a 1 GB drive. Wow, now we have two data points for increased density in a year. In 1992, we get a Seagate 2 GB drive with 7 MB/sec of transfer with a seek time of 8 ms and latency time of 4.17 ms. Now we're up to three data points.
Then it was time for analysts and various large organization that look at technology (and you know who I mean) to draw a straight line to show that the growth rate of storage is now on a path to double say every nine or 10 months. I saw those charts back in 1992 and laughed as I had talked to Seagate, knowing the facts. The first 4 GB drive from Seagate back then -- who led the industry -- was in 1994 with 9 GB in 1996. So many people in the industry read the analysts chart and believed that disk density would double based on the straight line drawn in 1992. I did not believe it then and I don't believe it now. But here we go again. Remember the expression, fool me once shame on you, fool me twice shame on me.
Time Machine: 2008
This claim is easily searchable: Flash density will continue to double every 12 to 18 months and flash technology in 2012 to 2014 will be less expensive and higher density than rotating storage (see Why Solid State Drives Wont Replace Spinning Disk ). Both claims I believe were based on charts I have seen come from drawing the same straight lines. Well, we're more than half way through 2011 and I have seen no signs of flash density or price getting close to disk storage even when comparing low-end MLC to SAS enterprise drives. So why would anyone say such a thing back in 2007 and 2008? Why did we believe it then and not run them out of town? Are we stupid or is it that we want to believe because it fits the model we want? Or is it because it is a simple model?
What? Tape is still alive?
The first time I heard that tape was dead was in 1994, but some others have told me they had heard it much earlier -- as early as the 1970s. Some vendors and some analysts have been predicting the death of tape for a long while. These people seem to be declaring the death of tape in a vacuum, not considering other factors such as power and cooling, reliability compared to disk drives, capability to ship tape media (sneakernet is so much faster and more cost effective than buying large amount of network bandwidth) and compression.