Efficient IO techniques are crucial in high-performance graph processing frameworks like Gunrock and Hornet, as fast graph loading can help minimize processing time and reduce system/cloud usage charges. This research study presents approaches for efficiently reading an Edgelist from a text file and converting it to a Compressed Sparse Row (CSR) representation. On a server with dual 16-core Intel Xeon Gold 6226R processors and Seagate Exos 10e2400 HDDs, our approach, which we term as GVEL, outperforms Hornet, Gunrock, and PIGO by significant margins in CSR reading, exhibiting an average speedup of \(78\times \) , \(112\times \) , and \(1.8\times \) , respectively. For Edgelist reading, GVEL is \(2.6\times \) faster than PIGO on average, and achieves an Edgelist read rate of 1.9 billion edges/s. For every doubling of threads, GVEL improves performance at an average rate of \(1.9\times \) and \(1.7\times \) for reading Edgelist and reading CSR respectively.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

GVEL: Fast Graph Loading in Edgelist and Compressed Sparse Row (CSR) Formats

  • Subhajit Sahu,
  • Kishore Kothapalli

摘要

Efficient IO techniques are crucial in high-performance graph processing frameworks like Gunrock and Hornet, as fast graph loading can help minimize processing time and reduce system/cloud usage charges. This research study presents approaches for efficiently reading an Edgelist from a text file and converting it to a Compressed Sparse Row (CSR) representation. On a server with dual 16-core Intel Xeon Gold 6226R processors and Seagate Exos 10e2400 HDDs, our approach, which we term as GVEL, outperforms Hornet, Gunrock, and PIGO by significant margins in CSR reading, exhibiting an average speedup of \(78\times \) , \(112\times \) , and \(1.8\times \) , respectively. For Edgelist reading, GVEL is \(2.6\times \) faster than PIGO on average, and achieves an Edgelist read rate of 1.9 billion edges/s. For every doubling of threads, GVEL improves performance at an average rate of \(1.9\times \) and \(1.7\times \) for reading Edgelist and reading CSR respectively.