Delete your CLAUDE.md (and your AGENT.md too)

Up: Theo | Previous | Next

Intro

Are you really an AI engineer if you haven't put a ton of time into your Agent MD or Claude MD files or both? Like, really? Come on, everyone's doing it. It has to be good, right? Well, what if I told you that a study just came out all about those Claude MD and Agent MD files? And uh the numbers weren't good. They're actually quite bad. Here we see comparisons across Sonic 4.5, GPT 4.5, 5.1 Mini, and Qwen 3. And when given an Agent MD or Claude MD file, they actually performed worse consistently. This is a thing we should probably be talking about, right? Like, I've been told so many times that I'm having prompt issues because I didn't write an Agent MD or Claude MD. They're so important. Every code base needs them. Everybody's publishing their own rule files and skills and all these things. It'd be pretty bad if it turned out those things were making the tools worse, right? Well, that's the thing we're going to have to dive into because on one hand, a lot of people are using these files wrong. And on the other hand, it is likely that they shouldn't be used at all for many cases because they steer models incorrectly. This is going to be a fun deep dive on context management and best practices for using AI to code and build real software. And a lot of this is coming from my own experience, which is admittedly subjective, but is really cool to see it coming out in a study. It's been awesome to see studies like this recently popping up. Things like figuring out if these Agent MD files are actually useful, Skills Bench figuring out how useful skills are as a thing that the models have access to when they are working. And even benchmarks that are trying to figure out why models are more likely to get a question right if you ask them the same thing twice. There's a lot of fun stuff to dive into here, and it's all about context management. And I do actually think this video can help you get better at using AI to code. That all said, I'm about to do a lot of work for free that OpenAI and Anthropic probably should be doing. Neither are paying me for this, and the team needs to get paid. So, we're going to do a quick break for today's sponsor.

Up: Theo | Previous | Next