Skip to content
aiqbench takeAI Products

aiqbench analysis

This article details a new feature in Cloudflare's Logpush service that integrates SQL-based transformations to filter, redact, and reshape log data directly within the export pipeline. By embedding this processing logic into the high-throughput delivery workflow, the update eliminates the need for separate downstream services to handle data normalization and privacy compliance before logs reach SIEMs or analytics platforms.
Source coveringCloudflare Blog
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Filter, reshape, and redact logs before export with Transformers

Cloudflare Blog8 min read

Logpush now supports Transformers, allowing teams to filter, redact, and reshape log streams using SQL before export. Powered by Apache DataFusion and Apache Arrow, Transformers apply those changes directly to log data before it reaches the destination.

Logpush delivers logs in batches as quickly as possible, enabling Cloudflare to provide information almost in real time. During our recent Birthday Week, we made Logpush available on all self-serve plans and Transformers generally available. Those changes were among eight major updates to Cloudflare Observability and reflect our commitment to make every Cloudflare feature available to everyone. This post takes a deeper look at how Transformers work inside Logpush's export pipeline. Observability teams use Logpush to export Cloudflare logs to security information and event management systems (SIEMs), analytics platforms, and object storage. Before those logs reach their destination, teams may need to remove health checks, omit sensitive fields, or reshape records for dashboards and investigations. Today, this often requires a separate processing service that teams must deploy, scale, monitor, and maintain. For example, a team that collects logs from multiple CDNs can add a static provider field…

Excerpt shown under the publisher's RSS terms · 147 words · full text and figures are on the publisher's site

Related coverage