akougkas.io

ChronoLog: A Distributed Shared Tiered Log Store with Time-based Data Ordering

Anthony Kougkas, Hariharan Devarajan, Keith Bateman, Jaime Cernuda, Neeraj Rajesh, Xian-He Sun

Proceedings of the 36th International Conference on Massive Storage Systems and TechnologySanta Clara University - School of Engineering

Abstract

Modern applications produce and process massive amounts of activity (or log) data. Traditional storage systems were not designed with an append-only data model and a new storage abstraction aims to fill this gap: the distributed shared log store. However, existing solutions struggle to provide a scalable, parallel, and high-performance solution that can support a diverse set of conflicting log workload requirements. Finding the tail of a distributed log is a centralized point of contention. In this paper, we show how using physical time can help alleviate the need of centralized synchronization points. We present ChronoLog, a new, distributed, shared, and multi-tiered log store that can handle more than a million tail operations per second. Evaluation results show ChronoLog’s potential, outperforming existing solution by an order of magnitude.

Finding

Using physical time to remove centralized synchronization points, ChronoLog handles more than a million tail operations per second and outperforms existing solutions by an order of magnitude.

System

  1. 2020–present
    active

    ChronoLog

    A distributed shared log that orders activity data by physical time instead of consensus. My MSST 2020 design, funded by NSF for six years, and now at version 3 with SQL, pub/sub, and an MCP server.

Browse all papers on ChronoLog
  1. 2026
    poster

    ChronoLog: Distributed Shared Tiered Log Store

    Eneko Gonzalez, Kun Feng, I. Brodkin, Kyle Chard, Anthony Kougkas, Xian-He Sun. 13th Greater Chicago Area Systems Research Workshop (GCASR 2026)

  2. 2025
    poster

    ChronoLog & AI: A Scalable, Collaborative Solution for LLM Conversation Logging & Retrieval

    S. Sonar, Jaime Cernuda, Anthony Kougkas, Xian-He Sun. 37th International Conference on Scalable Scientific Data Management (SSDBM 2025)

  3. 2024
    workshop

    Jarvis: Towards a Shared, User-Friendly, and Reproducible, I/O Infrastructure.

    Jaime Cernuda, Luke Logan, N. Lewis, Suren Byna, Xian-He Sun, Anthony Kougkas. The International Parallel Data Systems Workshop (PDSW’24)

  4. 2024
    conference

    HStream: A hierarchical data streaming engine for high-throughput scientific applications

    Jaime Cernuda, Jie Ye, Anthony Kougkas, Xian-He Sun. Proceedings of the 53rd International Conference on Parallel Processing

Citation

@inproceedings{kougkas2020chronolog,
  author = {Kougkas, Anthony and Devarajan, Hariharan and Bateman, Keith and Cernuda, Jaime and Rajesh, Neeraj and Sun, Xian-He},
  booktitle = {Proceedings of the 36th International Conference on Massive Storage Systems and Technology},
  title = {ChronoLog: A Distributed Shared Tiered Log Store with Time-based Data Ordering},
  year = {2020},
  month = oct,
  publisher = {Santa Clara University - School of Engineering},
  url = {https://msstconference.org/MSST-history/2020/Papers/06.ChronoLog.pdf},
}

Related notes

  1. essay

    One destination, N tiers

    Every tier supplies the application at once, and the application sees one destination. The thesis from a November 2026 talk to my group at the Gnosis Research Center, the six lines of I/O work behind it since 2016, and my bet that they are the foundation agents need for context.

    9 min
  2. essay

    Agent memory is a storage problem

    Memory for agents decomposes into tiers with different access patterns: episodic, semantic, procedural, working. Storage people already know how to build tiers, and a time-ordered shared log is the episodic one.

    8 min
  3. essay

    Physical time as a sequencer

    ChronoLog 1.0.0 is out. A distributed log can order by synchronized physical clocks and drop the central sequencer. Why that trade fits activity data, what 1.0 delivers, and what worries me about clocks.

    7 min