Publications
2026
- Zero-Knowledge Cloud AnalyticsZeying Zhu, Clarence Lam, Alexander Frolov, and 2 more authorsIn Proceedings of the ACM SIGCOMM 2026 Conference, Denver, CO, USA, 2026
We present zk-Analytics, a distributed cloud analytics system that enables publicly verifiable analytics without revealing raw logs or relying on trusted hardware in analytics providers’ infrastructure. Today’s cloud analytics are largely self-assertive: providers collect telemetry, perform aggregation, and report results, leaving external parties unable to verify correctness without access to sensitive data or trusted execution environments. zk-Analytics addresses this gap by augmenting analytics pipelines with lightweight append-only log commitments and verifiable aggregation and query execution using zero-knowledge proofs. The system cleanly separates online log commitment from offline, distributed batch aggregation and query verification, enabling scalability while keeping online overhead low. We implement zk-Analytics using a zkVM-based execution environment and evaluate it on real-world and synthetic workloads, demonstrating that verifiable, privacy-preserving cloud analytics is feasible for real-world cloud workloads.
- VisionASAP: Reimagining the Data Lifecycle using Application Semantic-Aware ProcessingMilind Srivastava, Zeying Zhu, Yajie Zhou, and 5 more authors2026Vision paper
Across many domains (e.g., observability, networking, security), data processing pipelines face what we refer to as the Cost-Scale-Performance (CSP) problem: achieving low Cost at large Scale, while maintaining high Performance. In response, we see several efforts to tackle CSP in various stages of the Collect-Transmit-Store-Analyze data lifecycle; such as approximate query processing in databases or sketches in network routers. Our work is driven by the simple insight: "seeing the forest for the trees". These proposed solutions (e.g., AQP, sketching, compression, rollup) addressing CSP share a common property – they exploit semantic-preserving opportunities to support application needs. In this paper, we make a case for ASAP, a paradigm that makes Application Semantic-Aware Processing (ASAP) a first-class design principle in data processing pipelines. We argue that by taking a unified view across ASAP primitives developed in different domains, across the entire data lifecycle, we can unlock new opportunities to tackle the CSP problem. In particular, we can: (i) enable novel cross-lifecycle optimizations such as analytics run directly on sketches computed at the source; (ii) leverage primitives developed in other application domains; and (iii) enable widespread adoption of these powerful techniques. We discuss research challenges in socializing the benefits of the ASAP paradigm, and show preliminary evidence that adopting ASAP can yield up to three orders of magnitude improvements in the CSP tradeoff for many application domains.
2025
- Approximation-First Timeseries Query At ScaleZeying Zhu, Jonathan Chamberlain, Kenny Wu, and 2 more authorsProc. VLDB Endow., Apr 2025
Timeseries monitoring systems such as Prometheus play a crucial role in gaining observability of the underlying system infrastructure. These systems collect timeseries metrics from various system components and perform monitoring queries over periodic window-based aggregations (i.e., rule queries). However, despite wide adoption, the operational costs and query latency of rule queries remain high. In this paper, we identify major bottlenecks associated with repeated data scans and query computations concerning window overlaps in rule queries, and present PromSketch, an approximation-first query framework as intermediate caches for monitoring systems. It enables low operational costs and query latency, by combining approximate window-based query frameworks and sketch-based precomputation. PromSketch is implemented as a standalone module that can be integrated into Prometheus and VictoriaMetrics, covering 70% of Prometheus’ aggregation over time queries. Our evaluation shows that PromSketch achieves up to a two-order-of-magnitude reduction in query latency over Prometheus and VictoriaMetrics, while lowering operational dollar costs of query processing by three orders of magnitude compared to Prometheus and by at least 4\texttimes compared to VictoriaMetrics with at most 5% average errors across statistics.
- Rearchitecting Approximation-First Cloud TelemetryZeying Zhu and Zaoxing LiuIn Proceedings of the ACM SIGCOMM 2025 Posters and Demos, Coimbra, Portugal, Apr 2025
Cloud-native telemetry systems like Prometheus enable observability through rule queries-window- and dimension-based aggregations over time series data. However, these queries incur high operational costs and latency due to raw data ingestion, repeated computations, and expensive storage. In this demonstration, we revisit the potential of approximate analytics to improve efficiency across the telemetry pipeline. We propose a hybrid, sketch-based caching architecture that unifies optimizations across ingestion, query processing, and storage. By supporting approximate representations at each stage, our design achieves significant cost savings while maintaining high accuracy and responsiveness.
2024
- Raising the Level of Abstraction for Sketch-Based Network Telemetry with SketchPlanMilind Srivastava, Shao-Tse Hung, Hun Namkung, and 3 more authorsIn Proceedings of the 2024 ACM on Internet Measurement Conference, Madrid, Spain, Apr 2024
While sketch-based network telemetry is attractive, realizing its potential benefits has been elusive in practice. Existing sketch solutions offer low-level interfaces and impose high effort on operators to satisfy telemetry intents with required accuracies. Extending these approaches to reduce effort results in inefficient deployments with poor accuracy-resource tradeoffs. We present SketchPlan, an abstraction layer for sketch-based telemetry to reduce effort and achieve high efficiency. SketchPlan takes an ensemble view across telemetry intents and sketches, instead of existing approaches that consider each intent-sketch pair in isolation. We show that SketchPlan improves accuracy-resource tradeoffs by up-to 12x and up-to 60x vs. baselines, in single-node and network-wide settings. SketchPlan is open-sourced at: https://github.com/milindsrivastava1997/SketchPlan.
- Poster: Circa: Re-imagining Network Telemetry from an Approximation-First PerspectiveMilind Srivastava and Vyas SekarIn Proceedings of the ACM SIGCOMM 2024 Conference: Posters and Demos, Sydney, NSW, Australia, Apr 2024
Telemetry systems are widely used to collect data from distributed endpoints, analyze data in conjunction to gain valuable insights, and store data for historical analytics. These systems consist of four stages (Figure 1): collection, transmission, analysis, and storage. Collectors at the endpoint collect various types of data, which is then transmitted to a central server for analysis. This data is used for multiple downstream tasks, such as dashboard monitoring and anomaly detection. Finally, this data is stored in long-term storage to aid retrospective analytics and debugging.