ChronoLog: A Distributed Shared Tiered Log Store with Time-based Data Ordering
Proceedings of the 36th International Conference on Massive Storage Systems and Technology · Santa Clara University - School of Engineering
Abstract
Modern applications produce and process massive amounts of activity (or log) data. Traditional storage systems were not designed with an append-only data model and a new storage abstraction aims to fill this gap: the distributed shared log store. However, existing solutions struggle to provide a scalable, parallel, and high-performance solution that can support a diverse set of conflicting log workload requirements. Finding the tail of a distributed log is a centralized point of contention. In this paper, we show how using physical time can help alleviate the need of centralized synchronization points. We present ChronoLog, a new, distributed, shared, and multi-tiered log store that can handle more than a million tail operations per second. Evaluation results show ChronoLog’s potential, outperforming existing solution by an order of magnitude.
Connected work
Citation
@inproceedings{kougkas2020chronolog,
author = {Kougkas, Anthony and Devarajan, Hariharan and Bateman, Keith and Cernuda, Jaime and Rajesh, Neeraj and Sun, Xian-He},
booktitle = {Proceedings of the 36th International Conference on Massive Storage Systems and Technology},
title = {ChronoLog: A Distributed Shared Tiered Log Store with Time-based Data Ordering},
year = {2020},
month = oct,
publisher = {Santa Clara University - School of Engineering},
volume = {},
number = {},
pages = {},
keywords = {Shared Log Storage Systems, Multi-Tiered Storage Hierarchy, Data-Intensive Applications, Storage Architectures},
doi = {},
url = {https://msstconference.org/MSST-history/2020/Papers/06.ChronoLog.pdf},
}