Apertus 1.5: From Open Text Models to Open Multimodal Reasoners

arXiv:2610.15542 (cs)

Authors:Project Apertus: Yixuan Xu (1), Yassine Turki (2), Vinko Sabolčec (2), Valentina Pyatkin (1), Tommy Chu (2), Sven Najem-Meyer (2), Sean F. Carroll (2), Robert Smith (1), Raphael Kreft (1), Oscar Alessandro Tazza (1), Oleg Lavrovsky (2), Nicola Irmiger (1), Matteo Santelmo (2), Marian Schneider (1), Juan García Giraldo (2), Hanna Yukhymenko (1), Eduard Ďurech (1), Davit Melikidze (1), Dani Tamayo (2), Bettina Messmer (2), Aryan Ahadinia (2), Anunay Yadav (2), Allen Huang (2), Ahmad Fraij (1), Alessandro Bombarda (2), Alex Padula (1), Alexander Hägele (2), Alexander Sternfeld (3), Anna Hedström (1), Anna Kosovskaia (1), Arthur Wuhrmann (2), Arundhati Balasubramaniam (1), Badr Al Mahouri (2), Barna Pasztor (1), Bartosz Szostakiewicz (1), Bich Ngoc Doan (2), Bryan Schmid (4), Burak Sezen (1), Camille Challier (2), Clément Charmillot (2), Dana Shayakhmetova (2), Daniel Perruchoud (4), David Brüggemann (5), David Isztl (6), Elia Palme (6), Emma Anastassova (2), Fabian Bösch (6), Faruk Zahiragić (2), Fawzi Roberto Mohamed (6), Fiona Panicali (4), Florian Kolly (2), Flynn Guerra (4), Francesco Monti (2), Frederike Lübeck (1), Gennaro Oliva (6), Haofeng Yang (1), Haoliang Shang (1), Helen El Khoury (2), Henrique Mendonça (6), Jannis Vamvas (7), Jérome Landolt (4), Jessica Lam (1), Jingchun Xiao (1), Jonathan Coles (6), Joshua Oyebanji (2), Khanh Nguyen (2), Konstantinos Pitas (1), Lasse B. Strand (1), Li Mi (1), Loïc Deslarzes (2), Lorenzo Baggi (1), Lorenzo Noci (1), Luca Baumann (1), Luca Sartori (1), Lukas Drescher (6), Marco De Negri (1), Marco Passerini (6), Mark Klein (6), Marko Stojanovic (2), Martin Majsec (2), Matin Ansaripour (2), Mattea Busato (2), Mauro Pellonara (2), Max Neuwinger (1), Michael Graber (4), Michal Tešnar (1), Michelle Wastl (7), Miguel Gila (6), Mikolaj Boronski (2), Morgane Magnin (2), Moritz Reihs (1), Mukhammadali Sayfiddinov (1), Nathan Ranchin (1 and 2), Nicolas Cuveillier (2), Oscar Wohlfahrt (2), Qianqian Zou (5), Rada Kamysheva (1), Rita Sevastjanova (1), Roman Machacek

et al. (32 additional authors not shown)

Abstract:Language models are becoming infrastructure, and infrastructure built in the open, by public institutions, on documented data, is the alternative to dependence on a few providers; Apertus shows this is viable at scale. Apertus 1.5 extends the fully open Apertus family from text to multimodal reasoning. Continued pretraining of the Apertus 1.0 models, on 4T additional tokens for the 8B and 2T for the 70B, adds image and audio understanding and extends the context window fourfold to 262,144 tokens; multimodality enters through the tokenizer, the language-model head remains restricted to text, and the architecture is unchanged. Supervised finetuning, long-context finetuning, reinforcement learning with verifiable rewards, and preference alignment complete the released models. Thinking is a flag of the chat template rather than a separate model, and lifts mathematical reasoning by up to 20 points on the 8B model. The released models improve over their predecessors on nearly every benchmark; among fully open models of its class, the 8B leads on knowledge, instruction following, and cultural benchmarks, and its instruction following surpasses all compared models, including open-weight ones. On image and audio understanding, a first for the family, the models are competitive with fully open multimodal models, strongest on document understanding and long-form and lower-resource speech recognition, while specialized vision and audio models remain ahead on perception and transcription of English and other high-resource languages. As in Apertus 1.0, we train only on openly available data, respect crawler opt-outs retroactively, and exclude restrictively licensed material. We release the model weights, data preparation and training recipes, and evaluation suites under permissive licenses; openness extends to values, with the Apertus charter guiding alignment stages published alongside the models.

Computation and Language (cs.CL)

arXiv:2610.15542 [cs.CL]

(or arXiv:2610.15542v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2610.15542 arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.