Skip to content
aiqbench takeAI Safety

aiqbench analysis

The article's primary subject is AI, specifically focusing on the psychological impact of Large Language Models like GPT-4 and the emerging field of AI alignment within academia. It details a personal narrative regarding career shifts from physics to AI safety driven by concerns over superintelligence and model behavior. TechPulse take: This piece explores the profound identity crisis and professional pivot experienced by researchers as generative models approach or exceed human capabilities, highlighting the urgent need for expertise in AI alignment. The narrative underscores how early interactions with unstable LLMs are catalyzing a migration of talent from traditional STEM fields to address existential risks posed by advanced systems.
Source coveringLessWrong
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

AI Chased Me From Academia

LessWrong5 min read

I usually tell people I got interested in AI after ChatGPT came out. This is technically true. But the full truth is more embarrassing: the thing that first convinced me that AIs would overtake humans as the dominant intelligence on Earth was a Twitter thread about Sydney, the mentally unstable search engine powered by GPT-4. This Twitter thread[1] changed the course of my life. It caused me to leave a dream job (the best physicists in the world were down the hall from me) and move across the country to do something fulfilling, interesting, and very, very important. This summer, thousands of academics, especially in math, are feeling a similar shock. They’re feeling the dread of knowing the activity they love most will be taken from them, and the far lesser dread of knowing superintelligent robots may kill every person on Earth. More than a few people have asked for my story, so here it is, in self-indulgent detail. There are two stories here: the internal story of my changing self-conception, and the external story of how I acquired the skills to switch from physics to AI alignment, with plenty of mistakes along the way. I don’t want to hold myself up as a paragon of wisdom—far from it—but if the way I felt three years ago resonates with the way you feel now, I hope my story can help you get through the pain faster. I Had a Mental Breakdown Because Someone Might be Smarter Than Me Being smart has always been an important part of why I value myself. C. S. Lewis would say that pride is the source of all evil, and a therapist would say that I need to find other things to value. But the Mike who read that fateful tweet had never read C. S. Lewis or been to therapy. I liked that I had this fun ability that made me useful and special. As I pondered AI progress, I was horrified to think of a world where everyone had a brain much better than mine sitting in their pocket. It wasn’t all vanity. I genuinely love physics. I love looking at the caustics at the bottom of the pool, I love the equipartition theorem, and while I was writing this paragraph, I finally realized why the period of an orbit should depend on the semimajor axis but not the eccentricity.[2] This happens because the slightly rippled surface refracts the light in different ways. So light hitting at point x would be mapped to x+d*f(x). For large enough d, that Jacobian can become singular, meaning a lot of light piles up on a single curve. That’s why we see caustics in swimming pools but not puddles. And as much as I loved learning and solving toy problems, I loved solving real problems more. I loved being able to make a difference in the shape of science, and I knew AI would take that away. I started running the numbers. It had taken more than two years to go from GPT-3 to ChatGPT. How long would it take to go from ChatGPT to Einstein? I could see an argument for 3 years, I could see an argument for 30. I couldn’t see an argument that I’d get to experience a full career as a physicist before the robots cut it short. I reran the arguments every way I could think of. I checked whether Moore’s law was really slowing down. I looked up the market cap of Nvidia, tried to figure out the implied timeline to AGI, then freaked out every time the price moved. I’m worried the above paragraph made it sound too scientific. So let me be clear: this was less ‘superforecaster’, more ‘mental health crisis’. I channeled the emotional energy into venues even less productive than browsing Twitter threads about LLMs. I snapped at people who did nothing wrong. When I watched television, I would force myself to speculate on the timeline for robots to take over TV writing.[3] It took me weeks to realize that something was really wrong with me. It took even longer to admit it to others. I felt embarrassed to admit how afraid I was of something that seemed like a science fiction plot mixed with petty egotism. But I have great friends and a great family, and even if they weren’t taking the imminent rise of superintelligent machines seriously, they took me seriously. People who cared about me gave me hugs. It really did help. But it didn’t help enough. I decided to see a therapist. One Weird Trick I got one really useful thing out of my therapist. I was clearly fixated on this AI thing, and fighting the disorder head-on was a losing battle. She told me to set aside a ‘worry hour’. There would be one hour every day when I was allowed to obsess as much as I wanted; the rest of the time would be an anxiety-free zone. Obviously, this was a stupid plan. Anxiety disorders don’t follow rules. I started doing it just so I could prove my therapist wrong. And… it worked. If the worry hour had given me 23 hours of relief for the cost of one hour of suffering, that would have been amazing. But the deal was actually much better than that. The hour I picked was 2-3 pm, which has a lot to recommend it as a designated time for sulking. The sun is always out, I’m usually around people, and qui

Read the full article at LessWrong

Related coverage