United States
Site Map Contacts Hitachi Global Community
Hu's Blog - Data Storage and Virtualization Thought Leader Hitachi - Inspire the Next

Hu Yoshida's Blog - Vice President | Chief Technology Officer

Home > Corporate > HDS Blogs > HDS Bloggers > Hu's Blog
Products, Solutions and more

Hu's Blog

Deduplication for Backup and Recovery

by Hu Yoshida on Dec 29, 2006

I recently saw an article by Beth Pariseau about reasons why people are not buying deduplication products. The main reason given was the slow speed of backup compared to non deduplication VTL solutions. Compared to tape libraries and VTLs which top out around 500MB/s, the Diligent ProtecTier solution is cited at 220 MB/s. While that is better than the 100MB/s that is cited for Data Domain, it is judged to be too slow.

I have another take on this. The speed of backup was a concern when backup was done during backup windows. Today most users will create a snapshot or clone copy and do their backup in the background without the need for backup windows. The main concern today is the recovery speed of backups. For recovery, we achieve 400 to 500 MB/s using one ProtecTier in front of an AMS 1000 modular array. So while the backup time does take longer today, it can be done using a shadow image copy, without impact to the application, and the recovery times are still comparable to other VTLs.  The major advantage of Diligent’s deduplication is to reduce the amount of data backed up by a factor of 25 to 1, and that is money.

In the meantime Diligent recently released a Feature Pack for ProtecTier that, among other enhancements, introduced performance enhancements which has shown sustained backup throughput of 260MB/s with 17% new data on an AMS 1000 disk system. This is close to 1 TB per hour.

The referenced article also cites unnamed Diligent reps as saying that adding clustered servers to the ProtecTier VTL to boost performance is on the products roadmap.

Related Posts Plugin for WordPress, Blogger...

Comments (4 )

Ming Zhang on 29 Dec 2006 at 7:18 pm

500GB/s? you sure it is not a typo?

Hu Yoshida on 07 Jan 2007 at 1:12 am

Thanks Ming Zhang, you are correct that was a Typo which I corrected.

Jimmie on 19 Jan 2007 at 12:50 am

I know some VTL de-duplication(Sepaton,etc) can be done AFTER the backup done, do you think it is a better way?

Greg Dubrule on 22 Feb 2007 at 8:11 am

Hu,
I believe the backup numbers achieved at Goldman’s were significantly higher than the 200 MB/s referenced. Is this true? Also- Diligent said clustered heads were roadmapped for Year End 2006….why has this now pushed to Q4 2007? eal enterprise customers highlight the SPOF with a single head.
Thanks

Hu Yoshida - Storage Virtualization Thought LeaderMust-read IT Blog

Hu Yoshida
Vice President and Chief Technology Officer

Connect with Us

     

Switch to our mobile site