SHARE
Facebook X Pinterest WhatsApp

Users Give Dedupe High Marks

NEW YORK — Data de-duplicationmay not be widely adopted just yet, but if a few contented users are any indication, it may not be long until the technology becomes a staple in IT environments. At a panel of dedupe users at the Storage Decisions conference here yesterday, three users — representing three different dedupe vendors […]

Written By
PS
Paul Shread
Sep 24, 2008
Enterprise Storage Forum content and product recommendations are editorially independent. We may make money when you click on links to our partners. Learn More

NEW YORK — Data de-duplicationmay not be widely adopted just yet, but if a few contented users are any indication, it may not be long until the technology becomes a staple in IT environments.

At a panel of dedupe users at the Storage Decisions conference here yesterday, three users — representing three different dedupe vendors — gave the technology high marks, and had few if any complaints.

While not many are using the technology, an informal poll at the start of the session by moderator Arun Taneja of the Taneja Group suggested that it could begin to catch on soon.

Only three of about 50 in the audience said they’re currently using the technology — but half the room raised their hands when asked if they were considering it. Including the panel, that made six users total out of a roomful of storage professionals.

Chances are those numbers may go up after yesterday’s panel.

The first speaker, David Dunkers of architectural firm Skidmore, Owings and Merrill, said Data Comain’s (NASDAQ: DDUP) dedupe technology has given the firm a 31-1 de-duplication ratio, faster, more reliable restores, longer data retention times, and a shorter backup window.

“I’m able to sleep a lot better at night,” said Dunkers.

Gregg Paulk of the Anderson Center for Autism, a NEC Hydrastor user, claimed a 44-1 dedupe ratio. He said no backups have failed since the center deployed the technology, and storage costs have dropped to less than 60 cents a gigabyte while being easier to manage. Backups are now 90 percent faster, he said.

Chris Watkis of the Grey Healthcare Group, a FalconStor (NASDAQ: FALC) customer, said he had no confidence in data integrity or recoverability before turning to a FalconStor VTL.

“The results were overwhelming,” he said: a dedupe ratio of about 72-1 and a big savings on storage costs.

“There were no records telling me what was being used,” he said. Now he uses FalconStor’s reporting function to determine when files are ready to go offline.

Taneja cautioned not to draw too much from the numbers — results will vary depending on file type — and Dunkers and Paulk said it took a while to achieve their results. Panel members also said that which solution you need will vary; Dunkers needed a NAS device, while Paulk and Watkis were looking at backup and archiving.

Watkis also stressed the importance of a good vendor relationship when choosing a new technology.

Watkis was the only one of the three to go through an upgrade cycle, and he said the firmware and software upgrade created only one minor problem, changing retention cycles. “I was very happy at the end of it,” he said.

Making Disk Backup a Reality

Dedupe was the subject of — or came up in — other sessions at the conference.

Curtis Preston, vice president of GlassHouse Technologies’ data protection services, said dedupe is making disk backup a reality.

“Disk backup requires dedupe to make it affordable,” he said.

But Preston echoed Taneja’s assertion that users need to find the right solution for them. “You must test it with your data,” he said.

He went over a number of options users need to consider, such as speed, local versus global data de-duplication, post-processing versus inline dedupe, and hashing versus delta differentials. Some data, such as seismic and medical imaging, aren’t well suited to dedupe, and some solutions can’t dedupe compressed data or multiplexed backups, he said.

In a session on virtualization, Stephen Foskett, director of Contoural’s data practice, said he didn’t think primary data de-duplication technology was ready for prime time just yet.

Only one in an audience of about 100 people said he was using primary data dedupe from NetApp (NASDAQ: NTAP) — and he said, “I love it.”

Back to Enterprise Storage Forum

PS

eSecurity Editor Paul Shread has covered nearly every aspect of enterprise technology in his 20+ years in IT journalism, including an award-winning series on software-defined data centers. He wrote a column on small business technology for Time.com, and covered financial markets for 10 years, from the dot-com boom and bust to the 2007-2009 financial crisis. He holds a market analyst certification.

Recommended for you...

10 Best NAS Cloud Backup Solutions for 2023
Leon Yen
Oct 27, 2023
What is Scale Out Storage: A Comprehensive Guide
Mary Shacklett
Oct 25, 2023
How to Choose the Right NAS Device for Your Business
Drew Robb
Oct 19, 2023
Enterprise Storage Forum Logo

Enterprise Storage Forum offers practical information on data storage and protection from several different perspectives: hardware, software, on-premises services and cloud services. It also includes storage security and deep looks into various storage technologies, including object storage and modern parallel file systems. ESF is an ideal website for enterprise storage admins, CTOs and storage architects to reference in order to stay informed about the latest products, services and trends in the storage industry.

Property of TechnologyAdvice. © 2025 TechnologyAdvice. All Rights Reserved

Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.