aiqbench analysis
This study finds that while GenAI-assisted workflows do not uniformly outperform traditional precedent searches in architectural design, they may offer specific benefits to novice students during the revision phase. However, reliance on these tools is linked to a decline in general creative self-efficacy and does not guarantee reduced cognitive load without refined prompting strategies. The findings underscore that the educational value of GenAI depends heavily on pedagogical framing and the preservation of human creative agency rather than just final output quality.
Generative AI Assisted Workflows in Architectural Conceptual Design: Performance, Creative Self-Efficacy, and Cognitive Load
arXiv:2601.10696v2 Announce Type: replace Abstract: Generative AI (GenAI) is increasingly adopted in design education, yet evaluating its educational value through final outcomes provides an incomplete picture. This study compares two ecologically plausible workflows in an architectural conceptual design task: GenAI-assisted image generation and ArchDaily-based precedent search. The comparison concerns complete workflows rather than the isolated contributions. Thirty-six students completed a two-phase design task, first designing independently and then revising with their assigned workflow. Eight judges rated design performance, while participants reported task-specific and general creative self-efficacy and cognitive load after each phase. Difference-in-differences analyses showed no significant overall differences between the GenAI and precedent-search workflows in design performance, cognitive workload, or task-specific creative self-efficacy. Beyond these null overall effects, three patterns were observed. General creative self-efficacy showed a significant relative decline under the GenAI workflow. A subgroup analysis suggested higher revision-phase performance among novice students using GenAI than among those using precedent search (F (1,32) = 4.303, p = 0.046). However, this exploratory interaction should be interpreted cautiously due to low rating reliability, small subgroup cells, and imprecise estimation. Third, exploratory prompt analyses suggested that iterative, task-specific prompting strategies (CD3, CD6) were associated with cognitive load reductions at the uncorrected level, but neither association survived multiple-comparison correction. Overall, the GenAI workflow did not produce uniform gains. Its educational value may depend on pedagogical framing, learner characteristics, and human-AI interaction structure, underscoring the need to preserve creative agency and develop prompt literacy.
Abstract:Generative AI (GenAI) is increasingly adopted in design education, yet evaluating its educational value through final outcomes provides an incomplete picture. This study compares two ecologically plausible workflows in an architectural conceptual design task: GenAI-assisted image generation and ArchDaily-based precedent search. The comparison concerns complete workflows rather than the isolated contributions. Thirty-six students completed a two-phase design task, first designing independently and then revising with their assigned workflow. Eight judges rated design performance, while participants reported task-specific and general creative self-efficacy and cognitive load after each phase. Difference-in-differences analyses showed no significant overall differences between the GenAI and precedent-search workflows in design performance, cognitive workload, or task-specific creative self-efficacy. Beyond these null overall effects, three patterns were observed. General creative self-efficacy showed a significant relative decline under the GenAI workflow. A subgroup analysis suggested higher revision-phase performance among novice students using GenAI than among those using precedent search (F (1,32) = 4.303, p = 0.046). However, this exploratory interaction should be interpreted cautiously due to low rating reliability, small subgroup cells, and imprecise estimation. Third, exploratory prompt analyses suggested that iterative, task-specific prompting strategies (CD3, CD6) were associated with cognitive load reductions at the uncorrected level, but neither association survived multiple-comparison correction. Overall, the GenAI workflow did not produce uniform gains. Its educational value may depend on pedagogical framing, learner characteristics, and human-AI interaction structure, underscoring the need to preserve creative agency and develop prompt literacy.
Artificial Intelligence (cs.AI)
arXiv:2601.10696 [cs.AI]
(or arXiv:2601.10696v2 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2601.10696 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 328 words
Related coverage

[AINews] not much happened today
Latent Space · Sep 18, 2026

[AINews] not much happened today
Latent Space · Sep 10, 2026

[AINews] Meta Muse Wonder & Wonder Full: MSL’s Claude 5.5-tier Frontier Model
Latent Space · Oct 13, 2026

[AINews] Reality Checks on AI News (Yegge shuts down Gas Town, Databricks’ +60% Astra cost)
Latent Space · Sep 17, 2026