Labios: A distributed label-based i/o system
Proceedings of the 28th International Symposium on High-Performance Parallel and Distributed Computing. · ACM
Karsten Schwan Best Paper Award at HPDC 2019. See the LABIOS story for project and collaborator context.
Abstract
In the era of data-intensive computing, large-scale applications, in both scientific and the BigData communities, demonstrate unique I/O requirements leading to a proliferation of different storage devices and software stacks, many of which have conflicting requirements. In this paper, we investigate how to support a wide variety of conflicting I/O workloads under a single storage system. We introduce the idea of a Label, a new data representation, and, we present LABIOS: a new, distributed, Label- based I/O system. LABIOS boosts I/O performance by up to 17x via asynchronous I/O, supports heterogeneous storage resources, offers storage elasticity, and promotes in-situ analytics via data provisioning. LABIOS demonstrates the effectiveness of storage bridging to support the convergence of HPC and BigData workloads on a single platform.
Connected work
Citation
@inproceedings{kougkas2019labios,
author = {Kougkas, Anthony and Devarajan, Hariharan and Lofstead, Jay and Sun, Xian-He},
booktitle = {Proceedings of the 28th International Symposium on High-Performance Parallel and Distributed Computing.},
title = {Labios: A distributed label-based i/o system},
year = {2019},
month = jun,
publisher = {ACM},
volume = {},
number = {},
pages = {13--24},
keywords = {Data Labels, Task-Based I/O, Elastic Storage, Storage Bridging},
doi = {10.1145/3307681.3325405},
url = {https://dl.acm.org/doi/abs/10.1145/3307681.3325405},
}