I'm Obsessed With Local AI. Here's Why

Up: Greg Isenberg | Previous | Next

Intro

I think local AI and open models are going to create a ridiculous number of business opportunities over the next 24 months and I don't think most people actually have the map yet.

They've used ChatGPT, they've used Claude, but when they hear local AI, Hugging Face, Ollama, LM Studio, AI Edge, it sounds like it's for this developer world and that normal founders are just not supposed to touch it. And I think that's a mistake because the opportunity here is actually pretty endless. By the end of today's episode, you're going to understand what local AI is, when it matters, how to run open models at work, where Hugging Face fits in here, which Gemma model I'd start with, how I'd run a model locally with LM Studio or Ollama, and how this turns into real business ideas. And I'll give you three startup ideas I'd actually consider building using local AI, including who the customer is, what the first version does, why local matters, and how I'd sell it. Basically, this is going to be a masterclass around local AI, how to run models, how to build apps, how to make money from it, and I'm going to explain it for the average person who isn't technical. Quick shoutout to Google for sponsoring today's episode and for caring about local AI and open models for entrepreneurs. Today's episode, I'm going to use Gemma and Google AI Edge as the main examples, but the goal is to give you a full map so you can actually understand the space and build with it and use whatever model suits you. Okay, let's dive in.

Up: Greg Isenberg | Previous | Next