Using FPGA to Accelerate Deduplication on High-Performance SSD

Abstract:

Data deduplication technology applied in solid state disks (SSD), can reduce the amount of write operations and garbage collection, and thus improve writing performance and prolong lifetime. With the significant increase of write performance onto SSD, whether deduplication based on SSD could be a performance bottleneck of SSD comes to a spot worthy of our attention. To this end, this paper, firstly, performs an experiment on achieving deduplication via software method, and reveals that software-based deduplication decreases SSD's read and write performance. And then a hardware-based deduplication with details is proposed and implemented to accelerate deduplication using FPGA, and expected results are achieved. Finally, we come to the conclusion that hardware-based deduplication can not only guarantee read and write performance of SSD, but also save storage capacity and enhance endurance.

• Periodical: Advanced Materials Research (Volume 1042)
• Pages: 212-217
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.1042.212
• Online since: October 2014
• Authors: Zheng Guo Chen*, Nong Xiao, Fang Liu, Yu Xuan Xing, Zhen Sun
• Keywords: Deduplication, Endurance, Hardware-Based, Performance, Software-Based, SSD

References

[1] D. G. Andersen and S. Swanson, Rethinking flash in the data center, IEEE Micro, vol. 30, no. 4, p.52–54, Jul. (2010).

DOI: 10.1109/mm.2010.71

[2] McKnight J, Asaro T, BabineauB. Digital archiving: end-user survey and market forecast 2006-2010 [EB/OL]. The Enterprise Strategy Group, (2006).

[3] F. Guo and P. Efstathopoulos, Building a high-performance deduplication system, in Proceedings of the 2011 USENIX conference on USENIX annual technical conference, (2011).

[4] S. Quinlan and S. Dorward, Venti: a new approach to archival storage, in Proceedings of the 1st USENIX conference on File and storage technologies, (2002).

[5] B. zhu, K. Li, and H. Patterson, Avoiding the disk bottleneck in the data domain deduplication file system, in Proceedings of the 6th USENIX Conference on File and Storage Technologies, 2008, p.18: 1–18: 14.

[6] F. Chen, T. Luo, and X. Zhang, caftl: a content-aware flash translation layer enhancing the lifespan of flash memory based solid state drives, in Proceedings of the 9th USENIX conference on File and storage technologies, (2011).

[7] http: /www. samsung. com/cn/consumer/computers-office/ssd-card/840-evo/MZ-7TE1T0BW.

[8] A. Gupta, Y. Kim, and B. Urgaonkar, dftl: a flash translation layer employing demand–based selective caching of page–level address map–pings, in Proceedings of the 14th international conference on Architecture support for programming languages and operating systems, 2009, p.229.

DOI: 10.1145/1508244.1508271

[9] http: /superuser. com/questions/253961/why–does–my–windows–7–pc–ssd–drive–kiip–freezing.

[10] Jonghwa Kim, Choonghyun Lee and Sangyup Lee, Deduplication in SSDs: Model and Quantitative Analysis, in Symposium on Mass Storage Systems – MSS, p.1–12, (2012).

[11] S. Lee and J. Kim, Understanding SSDs with the OpenSSD Platform, Flash memory Summit, http: /www. openssd–project. org, (2011).

[12] Saxena M, Zhang Y, Swift M M, et al. Getting real: lessons in transitioning research simulations into hardware systems, /FAST. 2013: 215-228.

[13] Xilinx vertex–6 family overview, http: /www. xilinx. com.