Anthropic Hires Legal Experts to Help AI Agents Negotiate Deals

Anthropic is consulting with law firms to tackle a new challenge: how AI agents should negotiate to secure the best deal outcomes for their human users. Two people familiar with Anthropic's thinking said the company is seeking advice from law firms on how lawyers conduct negotiations, with the aim of representing clients' interests while also achieving fair outcomes. A person familiar with Anthropic's project said the company is exploring "negotiation norms" for interactions between models. As intelligent systems continue to evolve, AI agents will represent users in dealing with other agents whose goals conflict with theirs. The person added that the company is also weighing how much agents should seek human feedback during negotiations, and how wary they should be of other AI counterparts while avoiding paranoid, conspiracy-style judgments. Another person close to the company said Anthropic has also considered an approach in which users would sign documents confirming the matters entrusted to the agent and all the rules it must follow. (Sina Finance)