distributed-llm-pretraining-torchtitan
From the author
Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.
Install
npx skills add KalarisLabs/research-agent-skills --skill distributed-llm-pretraining-torchtitan -a claude-code
Installs to .claude/skills/distributed-llm-pretraining-torchtitan/ · Each command fetches the skill straight from GitHub with the open skills CLI.
Byte-identical to the scanned commit, with the repository’s licence and a SOURCE.txt.
Want your agent to suggest skills while you type? See how to use skills from your IDE.
Safety checks on SKILL.md
No warnings.
Why 82
aiqbench computes the trust score from public signals. It is not a security audit, so read a skill before you install it.
Similar skills
Closest to this one by what they do and when they are used.
- pytorch-lightning-distributedKalarisLabs/research-agent-skillsHigh-level PyTorch framework with Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system, and minimal boilerplate. Scales from laptop to supercomputer with same code. Use when you want clean training loops with built-in best practices.Engineering★ 61
- pytorch-lightningOrchestra-Research/AI-Research-SKILLsHigh-level PyTorch framework with Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system, and minimal boilerplate. Scales from laptop to supercomputer with same code. Use when you want clean training loops with built-in best practices.Engineering★ 13.9K
- alterlab-pytorch-lightningAlterLab-IEU/AlterLab-Academic-SkillsScalable deep-learning training with PyTorch Lightning — organize PyTorch code into LightningModules, configure Trainers for multi-GPU/TPU, build data pipelines and callbacks, log to W&B or TensorBoard, and run distributed training (DDP, FSDP, DeepSpeed). Use when structuring PyTorch training loops, scaling neural-network training across GPUs/TPUs, or adding checkpointing, logging, and distributed strategies. Part of the AlterLab Academic Skills suite.Engineering★ 78
- deep-learning-pytorchMindrally/skillsExpert guidance for deep learning, transformers, diffusion models, and LLM development with PyTorch, Transformers, Diffusers, and Gradio.Other★ 286
- deep-learning-pythonMindrally/skillsGuidelines for deep learning development with PyTorch, Transformers, Diffusers, and Gradio for LLM and diffusion model work.Engineering★ 286
- pytorchMindrally/skillsPyTorch deep learning development with transformers, diffusion models, and GPU optimization.Other★ 286
Ratings & reviews
—
no reviews
Tried this skill? Rate it to help others. Sign in
Discussion
Join the discussion. Sign in