Presentation: Beyond Prompting: Context Engineering and Memory Management for AI Systems at Scale

Adi Polak: Today we're going to talk about beyond prompting. We're going to break some distributed systems down into parts and see how we can leverage that for memory management, for distributed AI systems that we're building. First of all, we want to start with something that is a little bit out of the ordinary. Has anyone here watched the movie, "Men in Black?" Do you remember the interview scene when Agent J, aka Will Smith, is interviewing for the job? Let's watch it. Zed: Edwards, what the hell happened? Edwards: Hesitated. Zed: May I ask why you felt little Tiffany deserved to die? Edwards: She was the only one that actually seemed dangerous at the time, sir. Zed: How'd you come to that conclusion? Edwards: First, I was going to pop this guy hanging from the street light. Then I realized he's just working out. How would I feel if somebody come running in the gym, bust me in my ass while I'm on a treadmill? Then I saw this snarling beast guy and I noticed he had a tissue in his hand. I realized he's not snarling, he's sneezing. There is no real threat there. Then I saw…