CIDR: A Large-Scale Industrial Source Code Dataset for Software Engineering Research

Abstract:We present the Curated Industrial Developer Repository (CIDR), a large-scale dataset of real-world software repositories collected from industrial partners. The dataset comprises 4,225 repositories spanning 75 programming languages, totaling 832 million raw lines of code (581 million logical lines), along with structured metadata at the repository level, full version control history, and engineering-practice attributes such as continuous integration usage and the presence of automated tests. All repositories were collected, filtered, and anonymized through a multi-stage pipeline developed specifically for this purpose. We additionally report an exploratory fine-tuning study that adapts a 3-billion-parameter code language model to CIDR and quantifies the effect on held-out enterprise code. CIDR is intended to support research in code intelligence, software quality analysis, developer tooling, and related software engineering tasks. Access to CIDR is provided under a restricted license; details on eligibility and terms are available at this https URL.

60 pages, 13 figures, 8 appendices. Dataset access: this https URL. Anonymization tool: this https URL. Metadata utility: this https URL

Software Engineering (cs.SE); Artificial Intelligence (cs.AI)

arXiv:2605.12153 [cs.SE]

(or arXiv:2605.12153v2 [cs.SE] for this version)

https://doi.org/10.48550/arXiv.2605.12153 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.