akougkas.io

NSF funds the next five years of IOWarp

A five-year NSF award for IOWarp, the collaboration with The HDF Group and the University of Utah that grew out of Hermes.

Published
Updated
Reading
2 min read
Topics
systems, data, scientific computing, agents, building

The collaboration behind IOWarp

  1. Gnosis Research Center

    Illinois Institute of Technology

  2. The HDF Group

    Research software and data systems

  3. University of Utah

    Collaborative research in scientific AI

IOWarp brings GRC, The HDF Group, and the University of Utah together around context management for scientific AI.

Thrilled to share that the National Science Foundation has funded IOWarp for five years, 2024 through 2029. It is a collaborative award among Illinois Tech’s Gnosis Research Center, The HDF Group, and the University of Utah, and it is the largest single research investment my group has been part of. The details are in the NSF record for OAC-2411318. I wrote the proposal, serve as a co-PI, and lead the architecture.

What we are building

IOWarp bridges HPC, AI, and data analytics with one idea: scientific workflows need a context layer, not only a faster byte pipe. The runtime moves data across storage tiers, reshapes it across formats, and exposes it to agents and people through tools with explicit contracts. It builds directly on Hermes, our multi-tier buffering system, and on years of work on labels, tracing, and task-based I/O.

The original announcement mentioned a specialized language model for natural-language data exploration. The plan evolved. What shipped instead is the CLIO ecosystem: a context store, a tool kit of MCP servers, a science agent, and a coding agent, which you can read about in the CLIO story.

What the award changes

Five years is enough time to do systems work properly: architecture, interfaces, implementation, integration, evaluation, documentation, releases, and time for people outside the lab to find the assumptions we missed. It also means students can own substantial pieces of the platform rather than isolated experiments.

An award is runway. The proof is in releases, and that is what the IOWarp organization has been accumulating since.

Sources, code, and records

  1. source

    NSF award OAC-2411318

    The public award record with scope, dates, institutions, and funding.

  2. source

    IOWarp at GRC

    The institutional project record.

  3. source

    IOWarp on GitHub

    Where the code has been landing since.

  4. source

    GRC news, August 2024

    The center's announcement of the NSF Frameworks award.

  • 2024–present
    active

    IOWarp

    Context management infrastructure for scientific AI

More on IOWarp

  1. update

    CLIO Core 2.3 and 2.4: when a tier fills or a node dies

    Four CLIO Core releases between October 9 and November 2, 2026 added a device-paged GPU vector and Intel GPU support, then taught the context store to recover a full tier and keep data and directories readable when a node goes down.

    3 min
  2. update

    Two years of IOWarp

    Two years after the NSF award, what IOWarp promised, what shipped as public releases, what changed course, and what is still a plan.

    4 min
  3. update

    CLIO in two Genesis Mission projects

    Two first-round DOE Genesis Mission projects, PORTUS with Pacific Northwest and SPOTTER-AI with Argonne, build on CLIO. What each asks of it, and why context and provenance matter when agents act on shared infrastructure.

    2 min