Download the authoritative guide: Enterprise Data Storage 2018: Optimizing Your Storage Infrastructure
Picking up where we left off in Part 1 of our look at the state of true integration in the storage sector, Part 2 addresses whether storage technology has reached the point where true integration is even achievable, discusses the possibility and likelihood of cooperation between storage vendors advancing the promise of true integration, and reveals whether a common set of management protocols such as SNIA's CIM-SAN-1 could change the future of integration.
To some folks in the storage industry the words ‘true integration’ are nothing more than an oxymoron. After all, as storage vendors continue to boast about true integration, storage customers continue to become more and more perplexed by it. And some are even beginning to wonder if ‘true integration’ should be taken off this year’s holiday list wish and placed on next year’s list instead.
Are Proprietary Protocols the Culprit?
Much of the talk concerning the challenges facing true integration seems to circle around the contention that perhaps the only reason these challenges even exist at all is because storage vendors are not always aware of the latest arrays offered by their competitors and may not have the drivers to support the various hardware available.https://o1.qnsr.com/log/p.gif?;n=203;c=204650394;s=9477;x=7936;f=201801171506010;u=j;z=TIMESTAMP;a=20392931;e=i
The other side of this conversation is that maybe these challenges exist because many storage vendors manage their storage arrays using proprietary protocols that make interoperability a challenge, and require either continual cross-licensing or reverse engineering by competitors.
Paul Ross, director of storage network marketing at EMC, believes that the issues with proprietary protocols are partially true when it comes to true integration and management systems. “The deeper one wants to go in terms of managing heterogeneous storage arrays, the more reliance there is on complying with management standards such as SMI-S and CIM,” says Ross.
However, Ross also points out that in the early days of Fibre Channel SANs, server I/O device drivers that could operate in a switched environment were brand new, and storage vendors had to adapt their then current ‘arrays’ to talk to these device drivers. “But,” he says, “today’s crop of storage arrays benefit from 5 years of development in the fabric device driver space, and there is surprisingly little difference in how switch fabric is implemented in the arrays.”
True Integration: A Two-sided Sword
Integration is a two-sided sword. The only way for vendors to achieve ‘differentiation’ is through proprietary protocols, and the need to differentiate inevitably leads to incompatibility. “Every vendor has its own solution to address storage issues, and that’s where solutions start to vary and diverge,” says Ross.
“That’s the nature of the business, since as competitors, companies do not share that much information with their rivals,” he continues. He also believes that there’s a slim chance that vendors will get together on their own to sort out the parameters/standards in such a way as to fit the customer’s application environment in a unified manner.
And the issue may not simply go away because of standards such as CIM. This is because, says Wayne Lam, vice president of professional services for FalconStor, from a management point-of-view, “you may have a single platform, but all the specific timings, error handling, etc. and all things not part of CIM dictate the behavior of each of the storage devices.”
“Each storage vendor has their own creative way of providing functionality, causing differences and obstacles to integration,” Lam continues. “For true integration to become a reality, you always need something that’s a neutral platform to talk to all of the storage and shield the host (consumer of storage) from any differences represented by the storage.”
Industry Standards: The Answer to True Integration?
Although it’s impossible to predict the future, one question looming over the industry is whether storage technology has reached the point where true integration is even achievable. Even with all of the obstacles and challenges in the path to true integration, Ross seems to think that true integration is still achievable because the industry is continuing to work together to develop management standards and many individual vendors are trading APIs to help achieve management interoperability.
Lam agrees with Ross’ assessment, although he argues it seems more like pulling teeth than real cooperation. “More and more industry standards and organizations, such as SNIA, are coming up with ways to force vendors to work together for the common goal of customer satisfaction,” says Lam.
Although standards groups do seem to be holding on to what seems like the only ray of hope for true integration, it still may be quite some time before it becomes a reality. Lam says that larger vendors with enormous resources can offer all kinds of strategies and ideas for a common standard, but their expectation is that all of the other vendors will follow their lead.
“However, this will not be the case. Other major players will not only not join the camp, they will start to create their own industry standards — as it is always tough for the big players to get together and truly follow the same set of protocols,” he continues.
SNIA – A Step in the Right Direction
Many folks believe that SNIA has done a lot of good work in getting competitive vendors to come together and map out how to best achieve commonality in networked storage management. “The standards are actually defined by the standards bodies like IETF and T11 committee of the INCITS, but the storage community belongs to all of the organizations,” says Ross.
Lam agrees that with all of the issues facing true integration, the best chance is with a common set of protocols such as CIM-SAN. “The only thing that has a remote chance to succeed for true integration is something like CIM,” contends Lam. He also says that it seems as though many vendors have at least publicly stated their support for CIM.
“If vendors can truly comply, the consumer/customer has a good chance for true integration,” says Lam. “But short of that,” he continues, “some other integrating agent, or neutral platform such as a separate storage appliance, will remain the only viable way to truly bring integration and interoperability today, rather than waiting for tomorrow.”
Cooperation Is Equivalent to Survival
Ross says that EMC believes that cooperation is equivalent to survival. “Customers will continue to demand commonality in networked storage management solutions, and those companies that do not work toward that end will most likely not be around in the future.”
Even though it looks as though there is a possibility for true integration, there are still many people out there who believe that the only way to change the state of true integration is through major cooperation between vendors.
Even though this seems like no big deal, and even though many vendors say they are more than willing to cooperate, there are still those like Lam who feel that “saying you are going to cooperate and actually cooperating are two very different animals.” If vendors actually cooperate, he says, “that will be the day. The track record has proven otherwise, though.”