Optimizing I/O for an Exascale Implicit Kinetic Plasma Simulation using the Rabbit Storage System
Abstract
Exascale computing revolutionizes scientific research by facilitating large-scale simulations and data analysis. As applications generate massive, heterogeneous data streams, the I/O subsystem increasingly dominates runtime, limiting scalability and time-to-solution. Emerging storage accelerators such as the Rabbit system offer a promising path forward. Rabbit provides dynamically configurable hybrid storage, combining high-bandwidth, node-local NVMe (e.g., XFS) with shared, distributed file systems (e.g., Lustre), to match diverse I/O patterns more efficiently. In this work, we evaluate Rabbit’s capability to mitigate I/O bottlenecks using iPIC3D, a representative implicit Particle-in-Cell (PIC) code for exascale scientific workloads. We perform a detailed characterization of the key phases of I/O (restart, field, and moment) and identify the dominant access patterns in these phases. We then benchmark these patterns using IOR in Rabbit hybrid storage configurations, identifying the ideal performance achievable for each access pattern under node-local and distributed storage modes. We use phase-aware mapping of these patterns to Rabbit storage systems, achieving a 4.85 times improvement in I/O throughput, reducing the I/O share of runtime from 38% to 11% and delivering an end-to-end speedup of 1.45 times. These results outline the importance of hardware-software co-design and highlight Rabbit as a scalable, data-intensive storage solution.
Finding
Phase-aware mapping of iPIC3D’s I/O patterns to Rabbit hybrid storage achieves a 4.85x improvement in I/O throughput, reducing the I/O share of runtime from 38% to 11% and delivering a 1.45x end-to-end speedup.
System
- 2024–present
IOWarp
The NSF-funded context-management program I proposed and architect across GRC, The HDF Group, and the University of Utah. IOWarp connects the HPC, storage, I/O, and data-systems lineage to scientific AI through the CLIO architecture.
More papers on IOWarp
Browse all papers on IOWarp- 2026
Trigger, Render, Reason: Multimodal LLM Agents for Science-Aware Scientific Simulation Monitoring
Hua Xu, Jaime Cernuda, Ana Gainaru, Scott Klasky, Anthony Kougkas, Xian-He Sun. International Conference for High Performance Computing, Networking, Storage, and Analysis (SC 2026)
- 2026
GPUH5: A GPU-first I/O Library for Scientific Data
J. Fernandes, Luke Logan, Xian-He Sun, Anthony Kougkas. 11th International Parallel Data Systems Workshop (PDSW 2026), held in conjunction with SC26
- 2026
Trigger-Gated Multimodal LLM Agents for In-situ Scientific Simulation Monitoring
Hua Xu, Jaime Cernuda, Anthony Kougkas, Ana Gainaru, Scott Klasky, Xian-He Sun et al. 11th International Parallel Data Systems Workshop (PDSW 2026), held in conjunction with SC26
- 2026
Type-Safe, Dynamically Defined Metadata Support for Scientific Applications
J. Teves, C. Brinker, Anthony Kougkas, Ana Gainaru, Scott Klasky, Xian-He Sun et al. 11th International Parallel Data Systems Workshop (PDSW 2026), held in conjunction with SC26
Citation
@inproceedings{lumsden2025rabbit,
author = {Lumsden, Ian and Devarajan, Hariharan and Yildirim, Izzet and Markidis, Stefano and Hu, Andong and Peng, Ivy and Pennati, Luca and Yokelson, Dewi and Brink, Stephanie and Pearce, Olga and Scogland, Tom and de Supinski, Bronis R. and Delzanno, Gian Luca and Kougkas, Anthony and Sun, Xian-He and Taufer, Michela},
booktitle = {REX-IO 2025 in conjunction with IEEE Cluster 2025},
title = {Optimizing I/O for an Exascale Implicit Kinetic Plasma Simulation using the Rabbit Storage System},
year = {2025},
month = sep,
publisher = {IEEE},
pages = {1--6},
doi = {10.1109/CLUSTERWorkshops65972.2025.11164212},
url = {https://doi.org/10.1109/CLUSTERWorkshops65972.2025.11164212},
} Related notes
- 7 min
2025 reflections
A personal record of 2025: a promotion, a keynote, two dissertations, a summer of teaching, a loss, and the argument I kept making all year about what a researcher is for now.
- 9 min
One destination, N tiers
Every tier supplies the application at once, and the application sees one destination. The thesis from a November 2026 talk to my group at the Gnosis Research Center, the six lines of I/O work behind it since 2016, and my bet that they are the foundation agents need for context.
- 4 min
SC26 in Chicago
What the group brings to SC26 in Chicago, the pressure from GPUs and agent fleets that runs through all of it, and an invitation to Thursday's Birds of a Feather on HDF5 in the age of AI-driven science.