akougkas.io

Optimizing I/O for an Exascale Implicit Kinetic Plasma Simulation using the Rabbit Storage System

Ian Lumsden, Hariharan Devarajan, Izzet Yildirim, Stefano Markidis, Andong Hu, Ivy Peng, Luca Pennati, Dewi Yokelson, Stephanie Brink, Olga Pearce, Tom Scogland, Bronis R. Supinski, Gian Luca Delzanno, Anthony Kougkas, Xian-He Sun, Michela Taufer

REX-IO 2025 in conjunction with IEEE Cluster 2025IEEE

Open the DOI

Abstract

Exascale computing revolutionizes scientific research by facilitating large-scale simulations and data analysis. As applications generate massive, heterogeneous data streams, the I/O subsystem increasingly dominates runtime, limiting scalability and time-to-solution. Emerging storage accelerators such as the Rabbit system offer a promising path forward. Rabbit provides dynamically configurable hybrid storage, combining high-bandwidth, node-local NVMe (e.g., XFS) with shared, distributed file systems (e.g., Lustre), to match diverse I/O patterns more efficiently. In this work, we evaluate Rabbit’s capability to mitigate I/O bottlenecks using iPIC3D, a representative implicit Particle-in-Cell (PIC) code for exascale scientific workloads. We perform a detailed characterization of the key phases of I/O (restart, field, and moment) and identify the dominant access patterns in these phases. We then benchmark these patterns using IOR in Rabbit hybrid storage configurations, identifying the ideal performance achievable for each access pattern under node-local and distributed storage modes. We use phase-aware mapping of these patterns to Rabbit storage systems, achieving a 4.85 times improvement in I/O throughput, reducing the I/O share of runtime from 38% to 11% and delivering an end-to-end speedup of 1.45 times. These results outline the importance of hardware-software co-design and highlight Rabbit as a scalable, data-intensive storage solution.

Finding

Phase-aware mapping of iPIC3D’s I/O patterns to Rabbit hybrid storage achieves a 4.85x improvement in I/O throughput, reducing the I/O share of runtime from 38% to 11% and delivering a 1.45x end-to-end speedup.

System

  1. 2024–present
    active

    IOWarp

    The NSF-funded context-management program I proposed and architect across GRC, The HDF Group, and the University of Utah. IOWarp connects the HPC, storage, I/O, and data-systems lineage to scientific AI through the CLIO architecture.

Browse all papers on IOWarp
  1. 2026
    conference

    Trigger, Render, Reason: Multimodal LLM Agents for Science-Aware Scientific Simulation Monitoring

    Hua Xu, Jaime Cernuda, Ana Gainaru, Scott Klasky, Anthony Kougkas, Xian-He Sun. International Conference for High Performance Computing, Networking, Storage, and Analysis (SC 2026)

  2. 2026
    workshop

    GPUH5: A GPU-first I/O Library for Scientific Data

    J. Fernandes, Luke Logan, Xian-He Sun, Anthony Kougkas. 11th International Parallel Data Systems Workshop (PDSW 2026), held in conjunction with SC26

  3. 2026
    workshop

    Trigger-Gated Multimodal LLM Agents for In-situ Scientific Simulation Monitoring

    Hua Xu, Jaime Cernuda, Anthony Kougkas, Ana Gainaru, Scott Klasky, Xian-He Sun et al. 11th International Parallel Data Systems Workshop (PDSW 2026), held in conjunction with SC26

  4. 2026
    workshop

    Type-Safe, Dynamically Defined Metadata Support for Scientific Applications

    J. Teves, C. Brinker, Anthony Kougkas, Ana Gainaru, Scott Klasky, Xian-He Sun et al. 11th International Parallel Data Systems Workshop (PDSW 2026), held in conjunction with SC26

Citation

@inproceedings{lumsden2025rabbit,
  author = {Lumsden, Ian and Devarajan, Hariharan and Yildirim, Izzet and Markidis, Stefano and Hu, Andong and Peng, Ivy and Pennati, Luca and Yokelson, Dewi and Brink, Stephanie and Pearce, Olga and Scogland, Tom and de Supinski, Bronis R. and Delzanno, Gian Luca and Kougkas, Anthony and Sun, Xian-He and Taufer, Michela},
  booktitle = {REX-IO 2025 in conjunction with IEEE Cluster 2025},
  title = {Optimizing I/O for an Exascale Implicit Kinetic Plasma Simulation using the Rabbit Storage System},
  year = {2025},
  month = sep,
  publisher = {IEEE},
  pages = {1--6},
  doi = {10.1109/CLUSTERWorkshops65972.2025.11164212},
  url = {https://doi.org/10.1109/CLUSTERWorkshops65972.2025.11164212},
}

Related notes

  1. personal

    2025 reflections

    A personal record of 2025: a promotion, a keynote, two dissertations, a summer of teaching, a loss, and the argument I kept making all year about what a researcher is for now.

    7 min
  2. essay

    One destination, N tiers

    Every tier supplies the application at once, and the application sees one destination. The thesis from a November 2026 talk to my group at the Gnosis Research Center, the six lines of I/O work behind it since 2016, and my bet that they are the foundation agents need for context.

    9 min
  3. field note

    SC26 in Chicago

    What the group brings to SC26 in Chicago, the pressure from GPUs and agent fleets that runs through all of it, and an invitation to Thursday's Birds of a Feather on HDF5 in the age of AI-driven science.

    4 min