Skip to content
aiqbench takeAI Research

aiqbench analysis

This paper investigates the formal representation of trust within multi-agent systems, specifically analyzing how different epistemic models handle the concept of betrayal when rationality assumptions are replaced by trustworthiness. By comparing lexicographic, ordinal closeness, and strong-belief frameworks, it reveals distinct structural failures in agents' belief hierarchies following a breach of trust, offering critical insights for designing robust AI collaboration protocols.
Source coveringarXiv
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Trust and Its Betrayal under Three Representational Strategies

arXiv3 min read

arXiv:2608.00321v1 Announce Type: new Abstract: Trust is a propositional attitude of a distinctive kind: to trust is to rely on another under conditions where reliance could be disappointed, and the disappointment of trust---betrayal---differs qualitatively from the disappointment of a prediction. We treat trust as a \emph{subjunctive} epistemic state: $A$ trusts $B$'s competence when $A$ believes that \emph{were $P$ true, $B$ would know it}, and $B$'s integrity when $A$ believes that \emph{were $B$ to know $P$, he would disclose it to $A$}. We develop three representations of this state---as lexicographic \emph{assumption} as \emph{ordinal closeness} in a Lewis--Stalnaker sphere system , and as \emph{strong belief} in a conditional probability system and for each we ask whether the Brandenburger--Keisler impossibility on common belief survives when the assumption of rationality is replaced by an assumption of trustworthiness. The three representations agree that every \emph{finite} depth of common trust is realizable while the \emph{completed} common-trust fixed point is the locus of difficulty, but they differ sharply in \emph{how} the difficulty manifests, and---our organizing finding---in how each survives a concrete betrayal. W show that the same betrayal refutes an agent's \emph{level ordering} under the lexicographic representation, contaminates her \emph{closeness ordering} in proportion to the betrayer's deliberateness under the ordinal representation, and merely \emph{shifts her operative conditioning hypothesis} while leaving her belief structure coherent under the strong-belief representation.

Abstract:Trust is a propositional attitude of a distinctive kind: to trust is to rely on another under conditions where reliance could be disappointed, and the disappointment of trust---betrayal---differs qualitatively from the disappointment of a prediction. We treat trust as a \emph{subjunctive} epistemic state: $A$ trusts $B$'s competence when $A$ believes that \emph{were $P$ true, $B$ would know it}, and $B$'s integrity when $A$ believes that \emph{were $B$ to know $P$, he would disclose it to $A$}. We develop three representations of this state---as lexicographic \emph{assumption} as \emph{ordinal closeness} in a Lewis--Stalnaker sphere system , and as \emph{strong belief} in a conditional probability system and for each we ask whether the Brandenburger--Keisler impossibility on common belief survives when the assumption of rationality is replaced by an assumption of trustworthiness. The three representations agree that every \emph{finite} depth of common trust is realizable while the \emph{completed} common-trust fixed point is the locus of difficulty, but they differ sharply in \emph{how} the difficulty manifests, and---our organizing finding---in how each survives a concrete betrayal. W show that the same betrayal refutes an agent's \emph{level ordering} under the lexicographic representation, contaminates her \emph{closeness ordering} in proportion to the betrayer's deliberateness under the ordinal representation, and merely \emph{shifts her operative conditioning hypothesis} while leaving her belief structure coherent under the strong-belief representation.

Artificial Intelligence (cs.AI)

arXiv:2608.00321 [cs.AI]

(or arXiv:2608.00321v1 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2608.00321 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 310 words

Related coverage