Skip to content
aiqbench takeAI Research

aiqbench analysis

GitSkills provides a massive dataset of Anthropic's agent skill specifications, offering researchers unprecedented visibility into how language models probabilistically select and reuse natural-language instructions from GitHub. This resource is critical for analyzing the evolution of autonomous agent behaviors, their maintenance patterns, and potential security vulnerabilities inherent in unverified, copy-paste-based deployment methods. By quantifying the scale of these artifacts, the dataset helps bridge the gap between theoretical agent design and empirical software engineering practices.
Source coveringarXiv
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

GitSkills: A Dataset of Agent Skills on GitHub

arXiv2 min read

arXiv:2608.10906v2 Announce Type: replace-cross Abstract: An agent skill is a folder containing a $\mathrm{SKILL.md}$ file with instructions for a language-model agent, optionally accompanied by scripts and reference files. The agent loads the skill when it judges that a task matches the skill description. Anthropic introduced the format in October 2025 as an open specification. Nine months later, public GitHub repositories hold millions of skill files. Skills are unlike the artifacts that software engineering researchers usually mine: they are written mainly in natural language, a model selects them probabilistically at run time, and no compiler or type checker verifies the selection. Skills also have no central registry or package manager; developers reuse them by copying folders between repositories. How developers write, reuse, and maintain skills is therefore an empirical question, and no existing dataset records this population. We present GitSkills, a dataset of 3,797,117 $\mathrm{SKILL.md}$ files collected from 282,200 public repositories in July 2026. The dataset retains every file occurrence with its repository, path, and content hash. We group identical files into 1,877,981 distinct contents and enrich one representative per group with the full text, parsed front matter, folder contents, repository metadata, and, for a subset, the commit history of the file. A single self-contained SQLite file supports research on the adoption, reuse, structure, authorship, maintenance, and security of agent skills.

Abstract:An agent skill is a folder containing a $\mathrm{this http URL}$ file with instructions for a language-model agent, optionally accompanied by scripts and reference files. The agent loads the skill when it judges that a task matches the skill description. Anthropic introduced the format in October 2025 as an open specification. Nine months later, public GitHub repositories hold millions of skill files. Skills are unlike the artifacts that software engineering researchers usually mine: they are written mainly in natural language, a model selects them probabilistically at run time, and no compiler or type checker verifies the selection. Skills also have no central registry or package manager; developers reuse them by copying folders between repositories. How developers write, reuse, and maintain skills is therefore an empirical question, and no existing dataset records this population. We present GitSkills, a dataset of 3,797,117 $\mathrm{this http URL}$ files collected from 282,200 public repositories in July 2026. The dataset retains every file occurrence with its repository, path, and content hash. We group identical files into 1,877,981 distinct contents and enrich one representative per group with the full text, parsed front matter, folder contents, repository metadata, and, for a subset, the commit history of the file. A single self-contained SQLite file supports research on the adoption, reuse, structure, authorship, maintenance, and security of agent skills.

G. Destefanis, D. Graziotin, M. Vaccargiu, and M. Ortu, "GitSkills: A Dataset of Agent Skills on GitHub", in Proceedings of the 24th IEEE/ACM International Conference on Mining Software Repositories (MSR '27). IEEE, Piscataway, NJ, USA, 2027, 3 pp. To appear

Software Engineering (cs.SE); Artificial Intelligence (cs.AI)

arXiv:2608.10906 [cs.SE]

(or arXiv:2608.10906v2 [cs.SE] for this version)

Full text under the publisher's open licence · 273 words

Related coverage