Enhancing knowledge tracing robustness for new question cold start in Intelligent Tutoring Systems

Abstract:Intelligent Tutoring Systems (ITS) provide personalized learning paths by diagnosing learners' proficiency. Knowledge Tracing (KT) models play a central role in this diagnosis by estimating learners' evolving knowledge states. However, in real-world ITS services, diagnostic reliability may decrease when newly introduced questions have no prior interaction history. This study aims to empirically identify the key features that support KT model robustness under the question cold start situation. To this end, we designed Practical Integrated Cross-consistent Knowledge Tracing (PICKT), which integrates multiple types of features, and examined which feature contributes to robustness under the question cold start situation. Among these features, we further analyzed difficulty, texts, and relational information derived from the knowledge map, which have been identified as important factors in prior KT research, to examine how each contributes to robustness under the question cold start situation. The results showed that difficulty feature was particularly informative for highly challenging questions, where the likelihood of a correct response rate was remarkably low. Meanwhile, the fused texts and knowledge map features supported robustness by enabling the model to estimate the representation of unseen questions by leveraging semantically and structurally similar questions observed during training. These findings suggest that maintaining KT robustness in ITS applications requires prioritization of feature annotation aligned with the characteristics of educational services.

Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

arXiv:2512.07179 [cs.AI]

(or arXiv:2512.07179v2 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2512.07179 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.