aiqbench analysis
This research provides a critical transparency layer for the generative AI sector by quantifying the full life-cycle environmental costs of developing a foundation model, including often-overlooked R&D stages like failed experiments and debugging. By applying life cycle assessment to the Moshi model, the study highlights that sustainability efforts must extend beyond final training runs to encompass the entire research pipeline and hardware manufacturing impacts. These findings offer essential data for researchers and policymakers aiming to mitigate the growing energy and resource footprint of large-scale AI development.
Environmental Footprint of GenAI Research: Insights from the Moshi Foundation Model
From arXiv
Full textarXiv:2604.11154v2 Announce Type: replace Abstract: New multi-modal large language models (MLLMs) are continuously being trained and deployed, following rapid development cycles. This generative AI frenzy is driving steady increases in energy consumption, greenhouse gas emissions, and a plethora of other environmental impacts linked to datacenter construction and hardware manufacturing. Mitigating the environmental consequences of GenAI remains challenging due to an overall lack of transparency by the main actors in the field.
Even when the environmental impacts of specific models are mentioned, they are typically restricted to the carbon footprint of the final training run, omitting the research and development stages. In this work, we explore the impact of GenAI research through a fine-grained analysis of the compute spent to create Moshi, a 7B-parameter speech-text foundation model for real-time dialogue developed by Kyutai, a leading privately funded open science AI lab. For the first time, our study dives into the anatomy of compute-intensive MLLM research, quantifying the GPU-time invested in specific model components and training phases, as well as early experimental stages, failed training runs, debugging, and ablation studies.
Additionally, we assess the environmental impacts of creating Moshi from beginning to end using a life cycle assessment methodology: we quantify energy and water consumption, greenhouse gas emissions, and mineral resource depletion associated with the production and use of datacenter hardware. Although Moshi is a specific case study, its development involves research stages common to most GenAI R&D pipelines. Our analysis therefore supports general practical recommendations for reducing compute usage and environmental impacts, while paving the way toward more sustainable MLLM research.
Abstract:New multi-modal large language models (MLLMs) are continuously being trained and deployed, following rapid development cycles. This generative AI frenzy is driving steady increases in energy consumption, greenhouse gas emissions, and a plethora of other environmental impacts linked to datacenter construction and hardware manufacturing. Mitigating the environmental consequences of GenAI remains challenging due to an overall lack of transparency by the main actors in the field. Even when the environmental impacts of specific models are mentioned, they are typically restricted to the carbon footprint of the final training run, omitting the research and development stages.
In this work, we explore the impact of GenAI research through a fine-grained analysis of the compute spent to create Moshi, a 7B-parameter speech-text foundation model for real-time dialogue developed by Kyutai, a leading privately funded open science AI lab. For the first time, our study dives into the anatomy of compute-intensive MLLM research, quantifying the GPU-time invested in specific model components and training phases, as well as early experimental stages, failed training runs, debugging, and ablation studies.
Additionally, we assess the environmental impacts of creating Moshi from beginning to end using a life cycle assessment methodology: we quantify energy and water consumption, greenhouse gas emissions, and mineral resource depletion associated with the production and use of datacenter hardware. Although Moshi is a specific case study, its development involves research stages common to most GenAI R&D pipelines. Our analysis therefore supports general practical recommendations for reducing compute usage and environmental impacts, while paving the way toward more sustainable MLLM research.
Artificial Intelligence (cs.AI)
arXiv:2604.11154 [cs.AI]
(or arXiv:2604.11154v2 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2604.11154 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 347 words
Related coverage
GeoNatureAgent Benchmark: Benchmarking LLM Agents for Environmental Geospatial Analysis Across Frontier and Open-Weight Foundation Models
arXiv · Jun 12, 2026
Active Tracking of Marine Pollution Sources: An Uncertainty-Aware Categorical Bayesian Framework for Unmanned Surface Vehicles
arXiv · Jul 21, 2026

Towards ecologically meaningful foundation models
Nature · Nov 6, 2026

Combatting water scarcity in Bangalore through lake restoration
Cisco Blogs · Oct 1, 2026