workshopcluster212021

pMEMCPY: a simple, lightweight, and portable I/O library for storing data in persistent memory

Luke Logan, Jay Lofstead, Patrick Widener, Xian-He Sun, Anthony Kougkas

Proceedings of the International Conference on Cluster Computing · IEEE

Read PDF DOI ↗

Abstract

Persistent memory (PMEM) devices can achieve comparable performance to DRAM while providing significantly more capacity. This has made the technology compelling as an expansion to main memory. Rethinking PMEM as storage devices can offer a high performance buffering layer for HPC applications to temporarily, but safely store data. However, modern parallel I/O libraries, such as HDF5 and pNetCDF, are complicated and introduce significant software and metadata overheads when persisting data to these storage devices, wasting much of their potential. In this work, we explore the potential of PMEM as storage through pMEMCPY: a simple, lightweight, and portable I/O library for storing data in persistent memory. We demonstrate that our approach is up to 2x faster than other popular parallel I/O libraries under real workloads.

Connected work

Labios

Citation

@inproceedings{logan2021pmemcpy,
  author = {Logan, Luke and Lofstead, Jay and Widener, Patrick and Sun, Xian-He and Kougkas, Anthony},
  booktitle = {Proceedings of the International Conference on Cluster Computing},
  title = {pMEMCPY: a simple, lightweight, and portable I/O library for storing data in persistent memory},
  year = {2021},
  month = sep,
  publisher = {IEEE},
  volume = {},
  number = {},
  pages = {664--670},
  keywords = {Computational Storage, I/O Acceleration, Storage Architectures, Data Movement Optimization},
  doi = {10.1109/Cluster48925.2021.00098},
  url = {https://ieeexplore.ieee.org/abstract/document/9555982},
}