Sari la conținut

Română · beta. Traducerea a fost făcută automat și este încă în curs de revizuire. Citește pagina în engleză

perspectiva aiqbenchMachine learning

analiza aiqbench

Cloudflare resolved a critical billing pipeline slowdown by optimizing ClickHouse's query planning stage, specifically by replacing exclusive locks with shared locks and refining part filtering. This fix addresses contention issues that emerged after scaling data partitions to hundreds of petabytes, offering a valuable reference for teams managing large-scale analytical workloads. The case highlights how subtle changes in partitioning schemes can expose hidden bottlenecks even when standard performance metrics appear normal.
Sursă care acoperăInfoQ
Ce este aceastaLectura unui model asupra articolului și a acoperirii conexe, scrisă pentru aiqbench. Nu sunt cuvintele publicației.

Cloudflare Identifies Query Planning Bottleneck in ClickHouse

InfoQ4 min de cititArticolul și perspectiva sunt în engleză.

Cloudflare recently described how a slowdown in its billing pipeline was traced to contention inside the query planning stage of ClickHouse. The team profiled the bottleneck and patched ClickHouse to replace an exclusive lock with a shared lock, drop the per-query copy of the parts list, and improve part filtering. By Renato Losio

Cloudflare recently described how a slowdown in its billing pipeline was traced to contention inside the query planning stage of ClickHouse. The team profiled the bottleneck and patched ClickHouse to replace an exclusive lock with a shared lock, drop the per-query copy of the parts list, and improve part filtering. Cloudflare's pipeline supports billing and fraud systems, so delays can affect multiple downstream services. After a migration that significantly increased the number of data parts, the…

Extras afișat conform termenilor RSS ai publicației · 76 cuvinte · textul integral și figurile sunt pe site-ul publicației

Subiecte conexe