Skip to content
aiqbench takeChips & Infra

aiqbench analysis

The article covers NVIDIA's SCADA model, which lets GPU threads issue storage I/O directly, and argues that the PCIe fabric and switches must become observable and congestion-aware to keep AI workloads fed. The vendor framing is promotional, and the claimed gains depend on small, random access patterns. For AI infrastructure readers, the useful point is that storage and interconnect design is becoming a limiting factor once GPUs drive I/O themselves.
Source coveringAstera Labs

48 SSDs With Full Visibility: Building an NVIDIA SCADA-Style Data Platform With Scorpio™ P-Series 320L Switch

Astera Labs7 min read

One 320L Scorpio™ P-Series 320L Smart Fabric Switch can connect 48 SSDs in an NVIDIA SCADA-style data platform. COSMOS and Nsight provide total visibility. The post 48 SSDs With Full Visibility: Building an NVIDIA SCADA-Style Data Platform With Scorpio™ P-Series 320L Switch appeared first on ASTERA LABS, INC..

Nearly every assumption in conventional storage topology design comes from an era when the CPU issued the reads. NVIDIA’s SCADA architecture removes the CPU from the storage metadata queue management, allowing thousands of GPU threads to issue fine-grained I/O requests directly to storage at massive parallel scale. That raises a more practical question for AI infrastructure: If thousands of GPU threads are issuing I/O directly, what must the fabric provide to keep AI workloads running efficiently? The fabric has changed from a passive interconnect to an observable, congestion-aware data-movement layer that must deliver high bandwidth and telemetry across GPUs, SSDs, and switches. This visibility allows developers to correlate fabric behavior with storage performance and identify the bottlenecks limiting throughput. SCADA stands for Scaled Accelerated Data Access,1 a…

Excerpt shown under the publisher's RSS terms · 127 words · full text and figures are on the publisher's site