DGAP: Efficient Dynamic Graph Analysis on Persistent Memory
SC(2024)
摘要
Dynamic graphs, featuring continuously updated vertices and edges, have grown
in importance for numerous real-world applications. To accommodate this, graph
frameworks, particularly their internal data structures, must support both
persistent graph updates and rapid graph analysis simultaneously, leading to
complex designs to orchestrate `fast but volatile' and `persistent but slow'
storage devices. Emerging persistent memory technologies, such as Optane DCPMM,
offer a promising alternative to simplify the designs by providing data
persistence, low latency, and high IOPS together. In light of this, we propose
DGAP, a framework for efficient dynamic graph analysis on persistent memory.
Unlike traditional dynamic graph frameworks, which combine multiple graph data
structures (e.g., edge list or adjacency list) to achieve the required
performance, DGAP utilizes a single mutable Compressed Sparse Row (CSR) graph
structure with new designs for persistent memory to construct the framework.
Specifically, DGAP introduces a per-section edge log to reduce write
amplification on persistent memory; a per-thread undo log to enable
high-performance, crash-consistent rebalancing operations; and a data placement
schema to minimize in-place updates on persistent memory. Our extensive
evaluation results demonstrate that DGAP can achieve up to 3.2× better
graph update performance and up to 3.77× better graph analysis
performance compared to state-of-the-art dynamic graph frameworks for
persistent memory, such as XPGraph, LLAMA, and GraphOne.
更多查看译文
关键词
Graphical Analysis,Persistent Memory,Dynamic Graph,Efficient Graph,Data Structure,Graph Structure,Storage Devices,Dynamic Framework,Edge List,Graphical Framework,Scalable,Metadata,Analysis Tasks,Load Data,Betweenness Centrality,Non-volatile Memory,Single Thread,Vertex Degree,Breadth-first Search,PageRank Algorithm,Graph Algorithms,Entire Array,Data Cache,Part Of The Graph,Connected Components,Source Vertex,Graph Operations,Data Backup,C++ Code
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要