Skip to content
aiqbench takeAI Products

aiqbench analysis

This update enhances XProf by enabling cycle-level visibility into custom Pallas kernels on TPUs, resolving previous opacity that obscured hardware stalls in trace captures. By integrating hardware performance counters with external event triggers, the tool now accurately attributes execution time to specific units like MXUs and ALUs, allowing developers to optimize memory tiling and instruction fusion for TPU v7 workloads.
Source coveringInfoQ
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Google Adds Cycle-Level Kernel Profiling to XProf

InfoQ3 min read

Google has added a Kernel Profiling suite to XProf. This is its open-source profiler for TPU workloads. Now, developers can see cycle-level details in custom Pallas kernels. Before, these kernels appeared as single opaque blocks in trace captures. By Claudio Masolo

Google has added a Kernel Profiling suite to XProf. This is its open-source profiler for TPU workloads. Now, developers can see cycle-level details in custom Pallas kernels. Before, these kernels appeared as single opaque blocks in trace captures. On TPU v7 (Ironwood), XProf samples hardware performance counters during runtime. In a tiled matmul example, Google found a memory stall.…

Excerpt shown under the publisher's RSS terms · 59 words · full text and figures are on the publisher's site

Related coverage