Rethinking key–value store for parallel I/O optimization
Abstract
Key–value stores are being widely used as the storage system for large-scale internet services and cloud storage systems. However, they are rarely used in HPC systems, where parallel file systems are the dominant storage solution. In this study, we examine the architecture differences and performance characteristics of parallel file systems and key–value stores. We propose using key–value stores to optimize overall Input/Output (I/O) performance, especially for workloads that parallel file systems cannot handle well, such as the cases with intense data synchronization or heavy metadata operations. We conducted experiments with several synthetic benchmarks, an I/O benchmark, and a real application. We modeled the performance of these two systems using collected data from our experiments, and we provide a predictive method to identify which system offers better I/O performance given a specific workload. The results show that we can optimize the I/O performance in HPC systems by utilizing key–value stores.
Finding
Key-value stores can optimize HPC I/O for workloads that parallel file systems handle poorly, and a predictive method identifies which system will perform better for a given workload.
System
-
IRIS
A unified I/O layer over POSIX files and object stores, from my doctoral work.
More papers on IRIS
Browse all papers on IRIS- 2022
LuxIO: Intelligent Resource Provisioning and Auto-Configuration for Storage Services
Keith Bateman, Neeraj Rajesh, Jaime Cernuda Garcia, Luke Logan, Jie Ye, … Anthony Kougkas et al. Proceedings of the 29th International Conference on High Performance Computing, Data, and Analytics
- 2022
LabStor: A modular and extensible platform for developing high-performance, customized I/O stacks in userspace
Luke Logan, Jaime Cernuda Garcia, Jay Lofstead, Xian–He Sun, Anthony Kougkas. Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
- 2022
Stimulus: Accelerate Data Management for Scientific AI applications in HPC
Hariharan Devarajan, Anthony Kougkas, Huihuo Zheng, Venkatram Vishwanath, Xian-He Sun. Proceedings of the 22nd IEEE International Symposium on Cluster, Cloud and Internet Computing
- 2021
HFlow: A Dynamic and Elastic Multi-Layered I/O Forwarder
Jaime Cernuda, Hariharan Devarajan, Luke Logan, Keith Bateman, Neeraj Rajesh, … Anthony Kougkas et al. Proceedings of the International Conference on Cluster Computing
Citation
@article{kougkas2017rethinking,
author = {Kougkas, Anthony and Eslami, Hassan and Sun, Xian-He and Thakur, Rajeev and Gropp, William},
journal = {International Journal of High Performance Computing Applications},
title = {Rethinking key--value store for parallel {I/O} optimization},
year = {2017},
publisher = {SAGE Publications Sage UK: London, England},
volume = {31},
number = {4},
pages = {335--356},
doi = {10.1177/1094342016677084},
url = {https://journals.sagepub.com/doi/abs/10.1177/1094342016677084},
}