analiza aiqbench
BrainSurgery is a tooling paper that moves common checkpoint operations like model merging, precision casting, and low-rank rewriting out of ad hoc Python scripts and into declarative YAML plans with validation, diffing, and sharded export. Its main claim is practical: across 13 settings and models up to 32B parameters, it reproduces specialized tools' edits at comparable cost and downstream performance, and coding agents write its plans more reliably and concisely than equivalent Python. Readers who run model surgery should watch whether the reproducibility and maintenance gains hold outside the authors' benchmarks.
BrainSurgery: Reproducible and Flexible Declarative Weight Manipulations for Model Editing and Upcycling
arXiv:2606.09707v2 Announce Type: replace Abstract: Checkpoint transformations such as model merging, precision casting, and low-rank rewriting are commonly implemented through Python code or separate task-specific tools. We present BrainSurgery, a tool that consolidates these operations into reusable declarative YAML plans over checkpoint tensors with built-in targeting, validation, diffing, and sharded export; a Web UI supports interactive inspection and plan construction. We compare BrainSurgery with three specialized systems across 13 settings, 11 benchmarks, 8 models, 4 architectures, and model sizes from 1.7B to 32B parameters. Without use-case-specific framework customization, BrainSurgery reproduces their model edits with comparable run cost, often lower memory usage, and close downstream performance. We further perform correctness, preservation, robustness, and scaling checks. Finally, a coding-agent study shows that agents can reliably generate and review BrainSurgery plans, which are substantially shorter and more structurally consistent than equivalent Python implementations. These results support BrainSurgery as a flexible alternative to maintaining separate tools for heterogeneous checkpoint-editing tasks.
Abstract:Checkpoint transformations such as model merging, precision casting, and low-rank rewriting are commonly implemented through Python code or separate task-specific tools. We present BrainSurgery, a tool that consolidates these operations into reusable declarative YAML plans over checkpoint tensors with built-in targeting, validation, diffing, and sharded export; a Web UI supports interactive inspection and plan construction. We compare BrainSurgery with three specialized systems across 13 settings, 11 benchmarks, 8 models, 4 architectures, and model sizes from 1.7B to 32B parameters. Without use-case-specific framework customization, BrainSurgery reproduces their model edits with comparable run cost, often lower memory usage, and close downstream performance. We further perform correctness, preservation, robustness, and scaling checks. Finally, a coding-agent study shows that agents can reliably generate and review BrainSurgery plans, which are substantially shorter and more structurally consistent than equivalent Python implementations. These results support BrainSurgery as a flexible alternative to maintaining separate tools for heterogeneous checkpoint-editing tasks.
Machine Learning (cs.LG); Computation and Language (cs.CL)
arXiv:2606.09707 [cs.LG]
(or arXiv:2606.09707v2 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2606.09707 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 247 cuvinte