Guides · Updated

Start here

Five steps for complete beginners, in the order that makes sense if you have never run a model on your own computer. Every link is a page already on this site.

1. What local AI is

Read these before you install anything, so you know what running a model on your own computer means and which words the other guides use.

  1. Local AI FAQ. Straight answers to the questions beginners ask most about running AI on their own computer, with links to the guide that goes deeper.
  2. Why run AI locally? Privacy, cost and control explained. What local AI actually protects, where it doesn't, when the cost works out, and how to keep a local setup genuinely private.
  3. Local AI glossary. Plain-English explanations of the terms you'll meet running AI locally, from VRAM and quantisation to GGUF, tokens, embeddings, RAG and LoRA, each linked to the guide that covers it.

2. Checking your hardware

Check the computer you already have, or the one you are thinking of buying, before you choose a model.

  1. GPU model picker. Enter your GPU VRAM, system RAM and what you want to do. Get Ollama models that fit, with quantisation, memory needed and estimated tokens per second.
  2. VRAM and quantisation explained: what actually fits on your GPU. Why a 9B model fits in 8GB, what Q4_K_M means, how context length eats memory, and why bandwidth sets your speed.
  3. Local AI on a budget PC (no big GPU). What an ordinary desktop or office PC can run with no graphics card or only a small one, the settings that help most, and the cheapest upgrades that make a real difference.
  4. Running local AI on a laptop: what actually works. What a gaming laptop, a MacBook or a plain office laptop can realistically run with Ollama, plus the laptop-specific gotchas: smaller VRAM, power limits, heat and battery.
  5. Local AI on a Mac with Apple Silicon. Why M-series Macs are good at local AI, how much memory you need, which apps to use (Ollama, LM Studio, MLX), and what to check before you buy.
  6. Running local AI on AMD, Intel Arc and mini PCs. Which AMD Radeon and Intel Arc GPUs work with Ollama, ROCm vs Vulkan, and how unified-memory mini PCs like the Ryzen AI Max+ 395 compare.
  7. Hardware for local AI, by tier. What you can run on 8GB, 12GB, 16GB and 24GB GPUs and unified-memory mini PCs, with hardware picks for each tier.
  8. What does running AI at home cost? Electricity for a desktop GPU or a mini PC, set against a paid chat plan, for a computer you already own and one you buy, in NZD and USD.
  9. Choosing a mini PC for local AI. How to choose a mini PC for local models: a basic small PC, a Mac mini or Mac Studio, or a unified-memory AMD machine, and what each one can run.

3. Installing the first app

Choose the app, then follow the install guide for Windows, Mac or Linux.

  1. LM Studio vs Ollama: which should you use? (2026). An honest comparison of the two most popular local AI apps: interface, licence, Mac MLX support, headless servers and integrations.
  2. How to install Ollama on Windows (2026). Install Ollama on Windows 10 or 11, run your first local model, check it's using your GPU, and move models to another drive.
  3. How to install Ollama on a Mac (Apple Silicon). Install Ollama on macOS, pick models that fit your unified memory, and know where files live.
  4. How to install Ollama on Linux (Ubuntu, Debian, Fedora, Arch). One-line install, NVIDIA and AMD GPU setup, running Ollama as a systemd service, and exposing it on your network safely.

4. Choosing a model

Learn what the model names mean, then open the 8GB, 12GB, 16GB or 24GB shortlist if that matches your card, or use the GPU picker for your exact setup.

  1. Ollama models explained: picking a model by size and task. What names like qwen3.5:9b, gemma4:e4b and 30b-a3b mean, how model size maps to memory, and which kind of model to use for chat, coding, reasoning, images and documents.
  2. Best local AI models for an 8GB GPU (2026). The Ollama models that fit fully on an 8GB card like the RTX 4060, RTX 5060 or RX 7600, by use case, with exact tags.
  3. Best local AI models for a 12GB GPU (2026). What runs on an RTX 3060 12GB, RTX 5070 or Arc B580: the best 9B-14B Ollama models by use case.
  4. Best local AI models for a 16GB GPU (2026). 16GB cards like the RTX 5060 Ti 16GB and RX 9070 XT unlock 20-24B models: gpt-oss 20B, Mistral Small 3.2, Devstral Small 2.
  5. Best local AI models for a 24GB GPU (2026). RTX 3090, 4090 or RX 7900 XTX? Here are the best 27-35B Ollama models that run fully on 24GB, from Qwen3.6 to Gemma 4 31B.
  6. GPU model picker. Enter your GPU VRAM, system RAM and what you want to do. Get Ollama models that fit, with quantisation, memory needed and estimated tokens per second.

5. Going further

After a first model runs, these are the next guides, from a chat window and your own files through to images, voice and looking after the setup.

  1. Running a local AI chat with a nice interface (Open WebUI and alternatives). Get a ChatGPT-style interface for your local models: setting up Open WebUI with Ollama, plus simpler desktop apps and browser extensions if you'd rather skip Docker.
  2. Chat with your documents locally: a simple RAG setup with Ollama. Build private document Q&A with Ollama: no-code options (Open WebUI, LM Studio) and a 40-line Python version you can understand.
  3. Set up a free local coding assistant (Continue, VS Code, Cursor). Use Ollama models for chat, edits and tab autocomplete in VS Code with Continue, plus the honest truth about local models in Cursor.
  4. Generating images locally: ComfyUI and Stable Diffusion for beginners. Make AI images on your own computer: which open image models fit your GPU, how to install ComfyUI and generate your first picture, and simpler apps if you'd rather skip the node graph.
  5. Local speech-to-text and text-to-speech on your PC. Transcribe recordings with Whisper and generate natural-sounding speech with Piper or Kokoro, all offline on your own computer, plus how to add voice to your local AI chat.
  6. Build a private voice assistant on your own PC. Turn a microphone, local speech recognition, a local chat model and a local voice into a spoken assistant that stays on your computer.
  7. What leaves your PC? A privacy checklist for local AI. Which features in Ollama, LM Studio, Open WebUI and the voice tools send data to the internet, and the documented setting that turns each one off.
  8. Local AI for privacy: keeping your documents off the cloud, step by step. A practical setup for asking AI about contracts, client files and notes without uploading them anywhere: what to install, which settings to turn off, and how to check nothing leaves your PC.
  9. When it doesn't work: troubleshooting local AI. The model is too big, replies crawl, the GPU sits idle, a download stalls, a port is taken, or the chat app can't see the model. What you'll see, the likely cause, and the fix.
  10. Keeping local models up to date and tidy (disk space, updates, removing old models). See what's using your disk, remove models you don't need, update Ollama and your models without surprises, and clear out the hidden caches that other AI tools leave behind.
  11. Local AI for a small business: a practical starter. A first local AI setup for a small team: one computer, one chat app, your own documents, and the privacy, licence and review checks before anyone relies on it.
  12. Running local AI agents safely on your PC. What can go wrong when a local model can read files, run commands and use tools, and a practical setup that limits the damage: approvals, one folder, secrets, sandboxes and MCP servers.
  13. Fine-tuning a small model with LoRA: what it is and when it's worth it. What fine-tuning and LoRA actually change in a model, when a better prompt or RAG is the smarter fix, what hardware and data you need, and how to run your own LoRA in Ollama.
Stuck on a step? When it doesn't work covers a model that will not load, slow replies, a GPU that sits idle, a download that stalls, a port already in use, and a chat app that cannot see the model.
Want the full list instead of a path? Every guide is on the guides index.

Get the Local AI weekly

New models worth running, what fits which GPU, and setup fixes. One short email a week, free. Unsubscribe any time.

Subscribe free →

Lila Forge Kits

Local-LLM App Starter

A tested starter for building your own app on Ollama: chat, RAG and a GPU-fit checker. Skip the setup hours.

kits.lilaforge.com →
VibeEngine

Best local LLM tools, ranked

Ollama, LM Studio, Open WebUI and llama.cpp scored from public evidence, with top picks.

vibeengine.lilaforge.com →