Insight for: Show HN: 500k+ events/sec transformations for ClickHouse ingestion

GlassFlow, a solution for high-throughput, stateful event transformations for ClickHouse ingestion

Analyzed: Apr 9, 2026

GlassFlow directly addresses a critical scalability and operational complexity pain point for enterprises utilizing ClickHouse for high-throughput data ingestion, particularly in observability and real-time analytics. The current industry practice of scaling by adding fragmented pipelines leads to duplicated logic, inconsistent state, and debugging difficulties. GlassFlow's approach of scaling within a single pipeline via replicas, supporting stateful transformations, and leveraging a file-based KV store, offers a superior architectural model. This product targets a mature market segment experiencing significant data volume growth, providing a robust solution for maintaining performance and operational simplicity at scale. The linear scaling and optimized ClickHouse sink are strong technical differentiators.

high-throughput pipelines ClickHouse ingestion observability real-time analytics backpressure state handling pipeline instances workload distribution replicas stateful transformations stateless ingestion file-based KV store in-memory state ClickHouse sink batching Go

Hacker News Post

Parent Entity

Show HN: 500k+ events/sec transformations for ClickHouse ingestion

Score: 11