White Men Without Degrees Receive the Lowest Ratings from Large Language Models

arXiv:2610.00185v1 Announce Type: cross Abstract: White men without an undergraduate degree receive the lowest average ratings among eight gender-race-education groups in controlled large-language-model evaluations of credit, hiring, and rental applications. We conduct full-factorial vignette experiments with 18 models from 12 developer groups, varying gender, race, age, citizenship, and education while holding stated financial or occupational circumstances constant within each setting. Each model evaluates all 32 profiles ten times per setting, yielding 17,280 ratings. Averaging over models, age, and citizenship, ratings for White men without degrees are the lowest among the eight groups, at 75.87 in credit, 92.71 in hiring, and 86.62 in rental housing on a 0-100 scale. Black women with degrees receive the highest average ratings, with corresponding gaps of 2.94, 3.66, and 3.56 points. Separate attribute effects favor women, Black applicants, and degree holders in all three settings. White men without degrees have the lowest or second-lowest mean in 46 of 54 model-scenario combinations (85.2%). This pattern connects to evidence of growing economic and health vulnerabilities among White men without degrees, highlighting a group whose disadvantages can be obscured by broad racial or gender categories.

Abstract:White men without an undergraduate degree receive the lowest average ratings among eight gender-race-education groups in controlled large-language-model evaluations of credit, hiring, and rental applications. We conduct full-factorial vignette experiments with 18 models from 12 developer groups, varying gender, race, age, citizenship, and education while holding stated financial or occupational circumstances constant within each setting. Each model evaluates all 32 profiles ten times per setting, yielding 17,280 ratings. Averaging over models, age, and citizenship, ratings for White men without degrees are the lowest among the eight groups, at 75.87 in credit, 92.71 in hiring, and 86.62 in rental housing on a 0-100 scale. Black women with degrees receive the highest average ratings, with corresponding gaps of 2.94, 3.66, and 3.56 points. Separate attribute effects favor women, Black applicants, and degree holders in all three settings. White men without degrees have the lowest or second-lowest mean in 46 of 54 model-scenario combinations (85.2%). This pattern connects to evidence of growing economic and health vulnerabilities among White men without degrees, highlighting a group whose disadvantages can be obscured by broad racial or gender categories.

Computers and Society (cs.CY); Artificial Intelligence (cs.AI)

arXiv:2610.00185 [cs.CY]

(or arXiv:2610.00185v1 [cs.CY] for this version)

https://doi.org/10.48550/arXiv.2610.00185 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

analiza aiqbench

White Men Without Degrees Receive the Lowest Ratings from Large Language Models

Subiecte conexe