akougkas.io

MegaMmap: Blurring the Boundary Between Memory and Storage for Data-Intensive Workloads

Luke Logan, Anthony Kougkas, Xian-He Sun

Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis SCIEEE Computer Society

Abstract

Large-scale data analytics, scientific simulation, and deep learning codes in HPC perform massive computations on data greatly exceeding the bounds of main memory. These out-of-core algorithms suffer from severe data movement penalties, programming complexity, and limited code reuse. To solve this, HPC sites have steadily increased DRAM capacity. However, this is not sustainable due to financial and environmental costs. A more elegant, low-cost, and portable solution is to expand memory to distributed multitiered storage. In this work, we propose MegaMmap: a software distributed shared memory (DSM) that enlarges effective memory capacity through intelligent tiered DRAM and storage management. MegaMmap provides workload-aware data organization, eviction, and prefetching policies to reduce DRAM consumption while ensuring speedy access to critical data. A variety of memory coherence optimizations are provided through an intuitive hinting system. Evaluations show that various workloads can be executed with a fraction of the DRAM while offering competitive performance.

Finding

MegaMmap reduces peak memory utilization by as much as 2.6x compared to leading solutions while accomplishing similar or better performance.

System

  1. 2024–present
    active

    IOWarp

  2. 2018–2024
    complete

    Hermes

  3. 2017–present
    evolving

    LABIOS

Browse all papers on IOWarp
  1. 2026
    conference

    Trigger, Render, Reason: Multimodal LLM Agents for Science-Aware Scientific Simulation Monitoring

    Hua Xu, Jaime Cernuda, Ana Gainaru, Scott Klasky, Anthony Kougkas, Xian-He Sun. International Conference for High Performance Computing, Networking, Storage, and Analysis (SC 2026)

  2. 2026
    workshop

    GPUH5: A GPU-first I/O Library for Scientific Data

    J. Fernandes, Luke Logan, Xian-He Sun, Anthony Kougkas. 11th International Parallel Data Systems Workshop (PDSW 2026), held in conjunction with SC26

  3. 2026
    workshop

    Trigger-Gated Multimodal LLM Agents for In-situ Scientific Simulation Monitoring

    Hua Xu, Jaime Cernuda, Anthony Kougkas, Ana Gainaru, Scott Klasky, Xian-He Sun et al. 11th International Parallel Data Systems Workshop (PDSW 2026), held in conjunction with SC26

  4. 2026
    workshop

    Type-Safe, Dynamically Defined Metadata Support for Scientific Applications

    J. Teves, C. Brinker, Anthony Kougkas, Ana Gainaru, Scott Klasky, Xian-He Sun et al. 11th International Parallel Data Systems Workshop (PDSW 2026), held in conjunction with SC26

Citation

@inproceedings{logan2024megammap,
  author = {Logan, Luke and Kougkas, Anthony and Sun, Xian-He},
  booktitle = {Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis SC},
  title = {MegaMmap: Blurring the Boundary Between Memory and Storage for Data-Intensive Workloads},
  year = {2024},
  month = nov,
  publisher = {IEEE Computer Society},
  pages = {1725-1742},
  doi = {10.1109/SC41406.2024.00114},
  url = {https://dl.acm.org/doi/abs/10.1109/SC41406.2024.00114},
}

Related notes

  1. essay

    One destination, N tiers

    Every tier supplies the application at once, and the application sees one destination. The thesis from a November 2026 talk to my group at the Gnosis Research Center, the six lines of I/O work behind it since 2016, and my bet that they are the foundation agents need for context.

    9 min
  2. essay

    Agent memory is a storage problem

    Memory for agents decomposes into tiers with different access patterns: episodic, semantic, procedural, working. Storage people already know how to build tiers, and a time-ordered shared log is the episodic one.

    8 min
  3. essay

    Why your AI infrastructure is already obsolete

    Obsolete means built on assumptions that no longer hold. Seven such assumptions behind current AI infrastructure, and the dissertation problem hiding in each, from a doctoral seminar at Illinois Tech.

    8 min