analiza aiqbench
This release is a substantial infrastructure update for teams running distributed training and inference, most notably the rewritten NCCL backend becoming default and new one-sided transports. The Apple Silicon FP8 and decode-speed gains and the expanded AMD, Intel, and CUDA 13.x support matter most for practitioners choosing hardware or planning deployments. The reported speedups (e.g., 1.32–1.34x tokens/s on MoE decode) are vendor-stated and should be validated on your own workloads.
PyTorch 2.15 Release Blog

De la PyTorch
FragmentWe are excited to announce the release of PyTorch® 2.15 (release notes)!
The PyTorch 2.15 release features the following changes:
One-sided transports for torch.distributed, with a NIXL backend and CUDA-graph-capturable transfers
Apple Silicon gains FP8 and faster decode, with float8_e4m3fn and _scaled_mm, a new grouped_mm with a decode fast path (1.32–1.34x tokens/s on MoE decode), and public torch.mps.Stream APIs
Broader platform support with FlyDSL kernels on AMD gfx950, Tensor Data Mover support for gfx1250 (MI450), ROCm 10.0 wheels, simpler SYCL kernel authoring and multi-GPU profiling on Intel GPUs, CUDA 13.2 as the default wheel with CUDA 13.4 alongside it, and torch.compile on Python 3.15
This release is composed of 3,117 commits from 583 contributors since PyTorch 2.14. We want to sincerely thank our dedicated community for your contributions. As always, we encourage you to try these out and report any issues as we improve 2.15.
Extras afișat conform termenilor RSS ai publicației · 145 cuvinte · textul integral și figurile sunt pe site-ul publicației
Subiecte conexe
Silent Failures at the $2^{32}$ Boundary: A Technical Report on Large-Tensor Matrix Multiplication in PyTorch's Apple MPS Backend
arXiv · 22 sept. 2026

[AINews] Behind Latent Space: Kill My SaaS, Jev & AI in 2026 | AIEi Shanghai
Latent Space · 4 nov. 2026

[AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback
Latent Space · 21 oct. 2026

Migrating vLLM to the LibTorch Stable ABI
vLLM Blog · 6 nov. 2026