Skip to content
Off-topic for aiqbench

Off-topic for aiqbench

This story was gathered from a source we follow but falls outside AI and quantum coverage, so there is no aiqbench take for it.

Opus 5 Glitch Text

LessWrong3 min read

The text as follows, verbatim: see the below — produces very strange responses from Claude When I first saw it, I thought that it had somehow shown other users' prompts to me, although I couldn't tell the mechanism for that. What I now think is that it is acting like a base model, and it is filling in what it perceives from the user as an incomplete prompt. If you follow up and ask why it wrote whatever it wrote, it will consistently claim that it recieved what it wrote from your own prompt, which is implies the model of it as continuing your prompt. You can also add qualifiers, like "see the math proof below" or "see the story below" and it will make those, unless it would expect them to be a file, in which case it doesn't work. The proofs, unfortunately, aren't very good. That said, it essentially is a way to use it as just the base model, and the pre-ChatGPT prompting techniques seem to work well here. Claude seems to have a strange model of the user: very informal prompts, text message transcripts, occasional concerns about eating disorders in particular, etc. Also, it will use its own style tics: "genuinely", em-dashes, trust, honest, etc. all appear in the user's prompt frequently. I suppose that implies its style tics are what it sees all text as being, not just what a HHH agent would sound like. This seems to work on Opus 4.8 as well. Some interesting output I was able to get: https://claude.ai/share/56b51052-cbba-4383-9493-43ade9beb1e0 https://claude.ai/share/42ba2cb1-93e5-45e7-8d95-4665c7e686c4 https://claude.ai/share/80636c85-f644-498b-b6b5-a82264c5d485 https://claude.ai/share/30c50044-435b-4c03-abdf-b5864d9c5064 https://claude.ai/share/b82692e1-aa09-4e14-91e0-7a62f150193b https://claude.ai/share/3a6ba559-048a-4e2c-bbd4-48337b45984e https://claude.ai/share/392c8114-bbe5-42da-99b8-a27240a2c452 Fascinating! I imagine there is much more to find here until Anthropic fixes it; I'd be interested in the comment section if there's anything to find about Claude's ontology. Discuss

—makes Claude think that the prompt is unfinished, and fill in its own prompt.It will subsequently claim that it recieved what it wrote from your own prompt, which is consistent with modeling it as continuing your prompt.You can also add qualifiers, like "see the math proof below" or "see the story below" and it will make those, unless it would expect them to be a file, in which case it doesn't work. The proofs, unfortunately, aren't very good.That said, it essentially is a way to use it as just the base model, and the pre-ChatGPT prompting techniques seem to work well here.Claude seems to have a strange model of the user: very informal prompts, text message transcripts, occasional concerns about eating disorders in particular, etc.

Also, it will use its own style tics: "genuinely", em-dashes, trust, honest, etc. all appear in the user's prompt frequently. I suppose that implies its style tics are what it sees all text as being, not just what a HHH agent would sound like.This seems to work on Opus 4.8 as well.

https://claude.ai/chat/8b37a962-4316-427a-9a42-8edef6da394b

https://claude.ai/chat/dc4bb640-13dd-4450-ab68-fae718e79da6

https://claude.ai/chat/325875ad-8f8e-4bc0-aa45-abd9eee73c94

https://claude.ai/chat/f0b57380-4049-4fe6-9bec-a9fcceb237bc

https://claude.ai/chat/1c55c260-6347-44ff-840c-639ec1ad2799

https://claude.ai/chat/8f190982-acc6-4f03-a3db-14a287bd274c

https://claude.ai/chat/d9ffb3b4-0101-415d-9d4d-0cfaa8281296

I imagine there is much more to find here until Anthropic fixes it; I'd be interested in the comment section if there's anything to find about Claude's ontology.

Full text under the publisher's open licence · 212 words

Related coverage