The Verge explores what it is like to run AI on your own computer

In short: A Verge writer is testing “local AI,” which means running an AI model on a personal computer instead of sending data to a company’s servers.

What's going on

Antonio G. Di Benedetto at The Verge started a personal “testing diary” about using AI tools more regularly, with a focus on running them locally. “Local AI” means the AI runs on your own machine, not in the cloud (the cloud is like renting a powerful computer over the internet).

The main appeal, he says, is privacy. If the AI runs on your computer, your notes, files, and prompts may not need to be sent to companies like OpenAI, Google, Microsoft, or Anthropic. He compares the idea to having a little helper that lives on your desk and answers only to you.

The Verge piece also highlights a practical tradeoff. To run larger AI models at home, you often need expensive hardware, especially lots of RAM (memory, like a bigger workbench that lets a computer juggle more things at once). Di Benedetto frames his project around a simple question, is local AI useful enough to justify buying a high-end desktop or laptop with a large amount of memory.

What to watch

More computer makers are selling new machines as “good for local AI,” including Apple’s latest Mac desktops and upcoming Windows PCs designed for AI tasks. The big question is whether local AI gets easier and cheaper, or if it stays a hobby that requires patience, setup time, and pricey computers.

Source: The Verge AI