Download the authoritative guide: Enterprise Data Storage 2018: Optimizing Your Storage Infrastructure
But the trend appears to be away from dedicated deduplication products with this function instead being part of a broader product suite. Probably the best example of this is Commvault Simpana data protection software. This platform includes deduplication, automated provisioning, management of cloud infrastructure (support for Amazon Web Services and Microsoft Azure), recovery, software snapshots, secure file sharing, search, endpoint data protection and virtual machine resource management.
“Today’s data management complexities, particularly the adoption of cloud technologies, are prompting more enterprises to look for ways to quickly and easily modernize their environments,” said Dave Simpson, Senior Analyst, Storage for the 451 Group. “CommVault’s, modular approach allows customers to address specific pain points, with the flexibility to upgrade to the full Simpana software suite.”
Similar to CommVault, HP folds its deduplication capabilities into other products. The problem with the current HP Enterprise site (HPE), however, is that you can’t find any of its deduplication tools or features easily. They appear to be lost in a sea of other offerings. Some detective work uncovered the HP Data Protector which is a backup and recovery product that includes deduplication, analytics and optimization features. It provides a platform for standardizing the backup and recovery of information spread across locations, applications, formats, storage platforms, operating systems and hypervisors. HP StoreOnce Backup also includes deduplication.
Bacula is a backup, restore and disaster recovery suite that includes Bacula Enterprise Deduplication Volumes. Deduplication Volumes store data on disks by aligning file boundaries to the block boundary of the underlying file system. Metadata, which does not align, is separated into a special metadata volume. Within the data volume, the space between the end of one file and the start of the next block boundary is left empty. Since every file begins on a block boundary, redundant data within files will deduplicate well using ZFS’s fixed block deduplication.