Download the authoritative guide: Enterprise Data Storage 2018: Optimizing Your Storage Infrastructure
Deduplication was the province of a couple of startups such as Data Domain about ten years ago. Since then, it has almost become ubiquitous. In fact, it is often included in other products as a feature. That said, there are still plenty of good deduplication tools out there.
Quantum’s DXi line of disk-based systems with built-in deduplication consists of several products. The DXi6900, for example, is built for enterprise-wide backup, disaster recovery and data protection. It provides up 510 TB of usable capacity in a 2U rack space. It provides 10GbE, 1GbE and 8 GB Fibre Channel (FC) connectivity.
EMC Data Domain utilizes high-speed, variable-length deduplication, which segments data to achieve dedupe efficiencies of 10x to 30x on average. Additionally, Data Domain Boost distributes parts of the deduplication process to the client or application server, so that the workload is spread across the server and Data Domain. Only unique data is sent across the network to the Data Domain system, enabling faster backup performance and more efficient resource utilization. The DD Boost ecosystem boasts over 15 applications – including the majority of the backup software market as well as enterprise applications like Oracle, Microsoft SQL and SAP. It also enables DBAs/app owners to control backup from their own utilities such as Oracle RMAN.
“DD Boost has changed the game for deduplication and ended the debate of client vs. target deduplication by providing the best of both worlds of deduplication,” said Peter Smails, Vice President of Marketing for Core Technologies at EMC. “It’s become the primary way applications write to Data Domain – including our own Avamar and NetWorker.”
He said that the majority of customers who purchase Avamar use its software capabilities (VMware integration, NAS backup) and write that data to Data Domain (using DD Boost). Therefore, Avamar deduplication is less relevant today as most Avamar users now take advantage of Data Domain.
Assigra Cloud Backup includes a wealth of features. As well as deduplication, it offers archiving, Continuous Data Protection (CDP), compression, encryption, VM replication and backup. On the dedupe side, it provides local as well as global deduplication i.e. it deduplicates across multiple sites at the same time.
NetBackup used to belong to Symantec but that company spun off its various backup products into Veritas. As such, NetBackup appliances and software include a deduplication engine for physical as well as virtual environments.
ASG acquired its deduplication and data protection capabilities from its purchase of Atempo four years ago. It provides source-based block level deduplication and backs up servers, desktops and laptops in remote offices and branch offices.