Streaming Quantiles Algorithms with Small Space and Update Time

Sensors (Basel). 2022 Dec 8;22(24):9612. doi: 10.3390/s22249612.

Abstract

Approximating quantiles and distributions over streaming data has been studied for roughly two decades now. Recently, Karnin, Lang, and Liberty proposed the first asymptotically optimal algorithm for doing so. This manuscript complements their theoretical result by providing a practical variants of their algorithm with improved constants. For a given sketch size, our techniques provably reduce the upper bound on the sketch error by a factor of two. These improvements are verified experimentally. Our modified quantile sketch improves the latency as well by reducing the worst-case update time from O(1ε) down to O(log1ε).

Keywords: quantiles; sketching; streaming.

MeSH terms

  • Algorithms*

Grants and funding

This research was supported in part by NSF CAREER grant 1652257 and NSF award 2107239.