ChronoLog: A Distributed Shared Tiered Log Store with Time-based Data Ordering
Abstract
Modern applications produce and process massive amounts of activity (or log) data. Traditional storage systems were not designed with an append-only data model and a new storage abstraction aims to fill this gap: the distributed shared log store. However, existing solutions struggle to provide a scalable, parallel, and high-performance solution that can support a diverse set of conflicting log workload requirements. Finding the tail of a distributed log is a centralized point of contention. In this paper, we show how using physical time can help alleviate the need of centralized synchronization points. We present ChronoLog, a new, distributed, shared, and multi-tiered log store that can handle more than a million tail operations per second. Evaluation results show ChronoLog’s potential, outperforming existing solution by an order of magnitude.
Finding
Using physical time to remove centralized synchronization points, ChronoLog handles more than a million tail operations per second and outperforms existing solutions by an order of magnitude.
System
- 2020–present
ChronoLog
A distributed shared log that orders activity data by physical time instead of consensus. My MSST 2020 design, funded by NSF for six years, and now at version 3 with SQL, pub/sub, and an MCP server.
More papers on ChronoLog
Browse all papers on ChronoLog- 2026
ChronoLog: Distributed Shared Tiered Log Store
Eneko Gonzalez, Kun Feng, I. Brodkin, Kyle Chard, Anthony Kougkas, Xian-He Sun. 13th Greater Chicago Area Systems Research Workshop (GCASR 2026)
- 2025
ChronoLog & AI: A Scalable, Collaborative Solution for LLM Conversation Logging & Retrieval
S. Sonar, Jaime Cernuda, Anthony Kougkas, Xian-He Sun. 37th International Conference on Scalable Scientific Data Management (SSDBM 2025)
- 2024
Jarvis: Towards a Shared, User-Friendly, and Reproducible, I/O Infrastructure.
Jaime Cernuda, Luke Logan, N. Lewis, Suren Byna, Xian-He Sun, Anthony Kougkas. The International Parallel Data Systems Workshop (PDSW’24)
- 2024
HStream: A hierarchical data streaming engine for high-throughput scientific applications
Jaime Cernuda, Jie Ye, Anthony Kougkas, Xian-He Sun. Proceedings of the 53rd International Conference on Parallel Processing
Citation
@inproceedings{kougkas2020chronolog,
author = {Kougkas, Anthony and Devarajan, Hariharan and Bateman, Keith and Cernuda, Jaime and Rajesh, Neeraj and Sun, Xian-He},
booktitle = {Proceedings of the 36th International Conference on Massive Storage Systems and Technology},
title = {ChronoLog: A Distributed Shared Tiered Log Store with Time-based Data Ordering},
year = {2020},
month = oct,
publisher = {Santa Clara University - School of Engineering},
url = {https://msstconference.org/MSST-history/2020/Papers/06.ChronoLog.pdf},
} Related notes
- 9 min
One destination, N tiers
Every tier supplies the application at once, and the application sees one destination. The thesis from a November 2026 talk to my group at the Gnosis Research Center, the six lines of I/O work behind it since 2016, and my bet that they are the foundation agents need for context.
- 8 min
Agent memory is a storage problem
Memory for agents decomposes into tiers with different access patterns: episodic, semantic, procedural, working. Storage people already know how to build tiers, and a time-ordered shared log is the episodic one.
- 7 min
Physical time as a sequencer
ChronoLog 1.0.0 is out. A distributed log can order by synchronized physical clocks and drop the central sequencer. Why that trade fits activity data, what 1.0 delivers, and what worries me about clocks.