Skip to content
aiqbench takeMachine Learning

aiqbench analysis

Cloze addresses the critical lack of standardized infrastructure for rigorously studying human-AI interactions within mental health research. By providing a unified environment to control model selection, prompt engineering, and safety constraints across major providers like OpenAI and Anthropic, it enables reproducible experiments that consumer chatbots cannot support. This tool is essential for building an evidence base on AI's role in therapeutic contexts while ensuring data sovereignty through local or cloud deployment options.
Sources coveringarXiv, SiliconANGLE, Kiro, The Verge

Cloze: An Open Research Platform for Studying Human-AI Conversations in Mental Health Contexts

arXiv2 min read

arXiv:2606.15033v1 Announce Type: cross Abstract: Cloze is an open-source web platform for conducting controlled, monitored studies of human-AI conversation in mental health research contexts. Consumer large language model (LLM) products such as ChatGPT, Claude, and Gemini are built for individual productivity, and offer researchers little experimental control, inconsistent data export, and no shared safety scaffolding that holds across providers. Cloze gives research teams a single environment in which they configure which models participants converse with, how the AI is instructed, how conversations are scheduled over time, and which safety constraints apply unconditionally, while every message is captured with full provenance (model version, prompt configuration, timing). The platform currently supports OpenAI, Anthropic, Google, and locally hosted open-weight models served through Ollama behind a unified interface, and runs in the cloud or fully on premises so that participant data need never leave an institution. Cloze is research infrastructure for building an evidence base on human-AI interaction in mental health contexts. It is not a therapeutic product.

Abstract:Cloze is an open-source web platform for conducting controlled, monitored studies of human-AI conversation in mental health research contexts. Consumer large language model (LLM) products such as ChatGPT, Claude, and Gemini are built for individual productivity, and offer researchers little experimental control, inconsistent data export, and no shared safety scaffolding that holds across providers. Cloze gives research teams a single environment in which they configure which models participants converse with, how the AI is instructed, how conversations are scheduled over time, and which safety constraints apply unconditionally, while every message is captured with full provenance (model version, prompt configuration, timing). The platform currently supports OpenAI, Anthropic, Google, and locally hosted open-weight models served through Ollama behind a unified interface, and runs in the cloud or fully on premises so that participant data need never leave an institution. Cloze is research infrastructure for building an evidence base on human-AI interaction in mental health contexts. It is not a therapeutic product.

7 pages, 2 figures. Cloze is released under AGPL-3.0

Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Computers and Society (cs.CY)

arXiv:2606.15033 [cs.HC]

(or arXiv:2606.15033v1 [cs.HC] for this version)

https://doi.org/10.48550/arXiv.2606.15033 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 270 words

Related coverage