Ox Alpha is INSANE

Up: Theo | Previous | Next

Intro

Last week there was a really interesting model drop, and the more I've been using it, the more impressed I've been. The model came out anonymously under the name Aux Alpha, and it was announced by Open Code and Open Router, which was interesting in and of itself because we don't know who made it, but there was one other detail that was even more interesting. We have capacity for 100 trillion tokens per day. That is crazy. That is so much compute, it's hard to even fathom. [snorts] On my absolute heaviest usage days, I'm doing upwards of like 7 billion tokens. All of Google's Gemini traffic in a given day is estimated in the 150 trillion token range. So, for whoever was hosting Aux Alpha to give this to one of a few providers in the trillions, hundred trillions range per day is just hard to fathom. So, either there is some hidden reserve of compute these guys have, or maybe this model's really small and cheap, and even then that's still a ton of compute. So, then we started to get some numbers. You guys might know Ben Davis, he's been in a bunch of my content, he does the podcast with me, helps with the channel a ton, good friend. Him and I were playing with it, and he started benching it against the subset of Deep Sweep problems that were public. It ended up scoring absurdly well. 5 6 [snorts] Soul got a 52%, People 5 got a 65%, and whatever the hell Aux was, somehow got an 80%. Something is up. Well, guess what? We actually know what the model is now, and it's definitely not what I expected when I first started playing with it. I will also say that the numbers being shared here are misleading, but it doesn't mean the model is bad. In fact, Aux Alpha has quickly become one of my most used models, and I really, really like using it. But, I bet you wouldn't have guessed it's a flash model. GLM 5.3 flash. It behaves better than 5 3, it behaves on par with models like Opus 4.8 at a 10th to a 100th the price. This is a wild model launch and there are so many fun details for us to dive into. I can't wait to show you everything that makes this model cool and all the things I've been using it for after a real quick break for today's sponsor.

Up: Theo | Previous | Next