Realizing space-efficient and high-performance inline deduplication for emerging hybrid storage system with Libra+
Journal of Systems Architecture(2024)
摘要
In the face of the ever-increasing data volume of data-intensive applications, deduplication, as a promising solution to reduce space consumption, has attracted increasing attention in modern storage systems. Specifically, in modern SSD caching-based hybrid storage systems, inline deduplication achieves data reduction on the fly before storing data in the SSDs, thereby enhancing performance and extending their lifespan. However, with the emergence of new storage media featuring fast access speed and high endurance, hybrid storage systems have evolved by incorporating these new storage devices in place of SSDs at the front end of the primary storage. In this work, we revisit the concept of inline deduplication in the context of emerging hybrid storage and propose a new inline deduplication system designed for emerging hybrid storage, named Libra+. Libra+ contains three components: First, we propose two cooperative index structures for memory and cache. Second, we design a selective deduplication approach to perform targeted deduplication. Third, we introduce a lightweight dirty list that replaces the conventional dirty list in inline deduplication, reducing time overhead and space costs. Experimental results show that Libra+ can achieve simultaneous performance improvement and space cost reduction.
更多查看译文
关键词
Deduplication,Storage system,Storage hierarchy,Emerging storage device
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要