Sari la conținut
aiqbenchInformații despre AI & calcul cuantic
ȘtiriAnalizeBenchmark-uriSkill-uriÎntreabă AIÎnvațăDespre
...Se încarcă sesiunea
ȘtiriAnalizeBenchmark-uriSkill-uriÎntreabă AIÎnvațăDespre

Română · beta. Traducerea a fost făcută automat și este încă în curs de revizuire. Citește pagina în engleză

Înapoi la listă
perspectiva aiqbenchCipuri & infrastructură

analiza aiqbench

This is a vendor-announced integration: PyTorch gains a native TPU device backend, and TorchTitan gets a TPU fork with scaling recipes. The practical question for readers is whether the claimed MFU and ease-of-porting hold up on their own models, so independent benchmarks and the fork's maturity are worth checking before committing. For teams already on PyTorch, it lowers the cost of evaluating TPUs without a JAX rewrite.
3
Surse care acoperăGoogle Developers Blog, arXiv, PyTorch

Integrating TorchTPU into TorchTitan and Optimizing Models for TPU

Google Developers Blog·20 octombrie 2026·22 min de citit·Articolul și perspectiva sunt în engleză.

De la Google Developers Blog

Fragment

TorchTPU integrates a native torch.device("tpu") backend directly into PyTorch, allowing developers to train large-scale models on Google Cloud TPUs without rewriting code in JAX. The TorchTitan TPU fork enhances this with production-grade scaling primitives like SimpleFSDP, Graph Trainer, and custom Pallas kernels that achieve high Model Flops Utilization (MFU) across dense and MoE architectures. Developers can leverage these battle-tested optimization playbooks, recipes, and the Hugging Face modeling backend to efficiently scale their own workloads on TPU infrastructure.

Over the past years, Meta’s TorchTitan has emerged as the PyTorch ecosystem’s premier clean-room reference platform for large-scale generative AI model training. Built entirely on PyTorch-native scaling primitives, TorchTitan provides an unencumbered, highly modular showcase for pre-training flagship dense and Mixture-of-Experts (MoE) architectures like Llama 3, Qwen 3, and FLUX.

Historically, developers looking to train PyTorch models on Google Cloud TPUs faced some challenges: either undertake a complete codebase rewrite into JAX, or grapple with legacy torch_xla. That paradigm has officially shifted. With the launch of TorchTPU, Cloud TPUs now feature a native backend (torch.device("tpu")) integrated directly into PyTorch's core interface. Enabling a training script to use TPUs now only requires minimal changes to your device initialization code. Providing device compatibility, however, is only half the battle, developers also need high performance production-grade, distributed training recipes.

This is where TorchTitan on TPU comes in. TorchTitan TPU is a fork of Meta’s TorchTitan implementation that is adapted to enable model training on Google Cloud TPUs. The fork is available at https://github.com/google-pytorch/torchtitan/

Rather than requiring engineering teams to invent custom TPU sharding strategies or hand-craft low-level XLA communication passes from scratch, Google and Meta co-developed TPU-native execution passes directly inside TorchTitan.

Extras afișat conform termenilor RSS ai publicației · 199 cuvinte · textul integral și figurile sunt pe site-ul publicației

Citește pe Google Developers Blog ↗Întreabă despre acest articol

Alte relatări ale acestei știri

  1. 20 oct.Google Developers Blog · acest articol
  2. 20 oct.arXiv · TorchTPU - A Hybrid Eager/Compiled Architecture for Native PyTorch Execution on TPU
  3. 20 oct.PyTorch · Introducing TorchTPU

Subiecte conexe

Machine learning

TorchTitan Update: New SOTA Models, Performance at Scale, TitanRL

PyTorch · 21 oct. 2026

Machine learning

PyTorch Conference North America 2026: Accelerating Open Intelligence Together

PyTorch · 22 oct. 2026

Machine learning

Reproducing AMD MLPerf Training v6.0 Submission Result

AMD · 16 iun. 2026

Cipuri & infrastructură

Technical Deep Dive into AMD MLPerf Training v6.1 Results

AMD · 16 nov. 2026

Alte relatări ale acestei știri

  1. 20 oct.Google Developers Blog · acest articol
  2. 20 oct.arXiv · TorchTPU - A Hybrid Eager/Compiled Architecture for Native PyTorch Execution on TPU
  3. 20 oct.PyTorch · Introducing TorchTPU

Article info

Source

Google Developers Blog

Published

20 octombrie 2026

Read time

22 min

Category

Cipuri & infrastructură
aiqbench
Informații despre AI & calcul cuantic© aiqbench. Toate drepturile rezervate.

Fluxuri:RSS·JSON Feed

LimbăEnglish·Românăbeta
ȘtiriAI & tehnologieCuanticAnalize
ExploreazăBenchmark-uriÎnvață
CompanieDespreÎncredereInformații legaleTermeni și condițiiPolitica de confidențialitateNotificări privind drepturile de autorȘtergerea datelorRaportează conținut

Perspectiva aiqbench, analizele, rezumatul zilnic și răspunsurile din Întreabă sunt scrise de modele AI din sursele afișate, fără revizuire editorială înainte de publicare. Pot conține erori — verifică sursa. Cum este folosit modelul →

  • Știri
  • Analize
  • Întreabă
  • Topuri
  • Cont