aiqbench analysis
This research introduces a specialized Transformer architecture for synthesizing room layouts within Building Information Modeling (BIM) environments by encoding architectural entities as sparse attribute-feature matrices. The study demonstrates that domain-specific sequence models can effectively handle constraint-aware spatial generation, offering performance advantages over bridged general-purpose LLMs and VLMs in this niche application area.
BIM-Native Tokenization for Constraint-Aware Room Layout Synthesis
arXiv:2512.04832v3 Announce Type: replace-cross Abstract: We present a BIM-native tokenization for room-level layout synthesis in Building Information Modeling (BIM) scenes. The core contribution is representational: we encode each room as a sequence of BIM-Token Bundles, realized as columns of a sparse attribute-feature matrix that unifies categorical and continuous attributes of walls, openings, and entities under wall-referenced (translation/scale-invariant) coordinates. A mixed-type embedding module produces a unified token vector from this matrix; a single Transformer backbone is then trained in two modes: encoder-only for room embeddings and retrieval, and encoder-decoder for autoregressive entity placement, which we call Data-Driven Entity Prediction (DDEP). On a controlled same-data benchmark with shared ontology and evaluation harness, DDEP outperforms ATISS and BLT baselines bridged into our representation, with ablations identifying joint continuous-feature embedding and entity ordering as primary drivers. Encoder embeddings cluster rooms by type more tightly than large general-purpose text encoders, which in turn retain an edge on within-type ranking. We frame this work as evidence that modestly sized, domain-specific sequence models over well-designed BIM tokenizations are a useful primitive for constraint-aware spatial generation, complementary to general-purpose LLMs/VLMs which we also benchmark.
Abstract:We present a BIM-native tokenization for room-level layout synthesis in Building Information Modeling (BIM) scenes. The core contribution is representational: we encode each room as a sequence of BIM-Token Bundles, realized as columns of a sparse attribute-feature matrix that unifies categorical and continuous attributes of walls, openings, and entities under wall-referenced (translation/scale-invariant) coordinates. A mixed-type embedding module produces a unified token vector from this matrix; a single Transformer backbone is then trained in two modes: encoder-only for room embeddings and retrieval, and encoder-decoder for autoregressive entity placement, which we call Data-Driven Entity Prediction (DDEP). On a controlled same-data benchmark with shared ontology and evaluation harness, DDEP outperforms ATISS and BLT baselines bridged into our representation, with ablations identifying joint continuous-feature embedding and entity ordering as primary drivers. Encoder embeddings cluster rooms by type more tightly than large general-purpose text encoders, which in turn retain an edge on within-type ranking. We frame this work as evidence that modestly sized, domain-specific sequence models over well-designed BIM tokenizations are a useful primitive for constraint-aware spatial generation, complementary to general-purpose LLMs/VLMs which we also benchmark.
Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG)
I.2.10; I.3.5; J.6
arXiv:2512.04832 [cs.CV]
(or arXiv:2512.04832v3 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2512.04832 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 284 words
Related coverage

[AINews] Reality Checks on AI News (Yegge shuts down Gas Town, Databricks’ +60% Astra cost)
Latent Space · Sep 17, 2026

News
Quantum Computing Report · Jul 25, 2026
Links #3: 2026/06 Part 1
LessWrong · Jun 15, 2026
DI Series: Serving Kimi-K3 MXFP4 Wide-EP Disaggregated on AMD Instinct MI300X and MI325X
AMD · Oct 8, 2026