Home · Updated

What does running AI at home cost?

A paid chat plan is a monthly fee. A model on your own computer has no fee from Ollama or LM Studio. You pay for the hardware if you buy it, and for electricity while the machine works.

The worked example assumes NZ$0.30 per kWh and US$0.15 per kWh. Those two prices are assumptions, picked so the arithmetic is easy to follow. They are not a national average, and they are not your bill. The calculator further down starts with the same prices and lets you replace them.

A computer you own, and one you buy

Two bills get mixed together. Separating them is the whole comparison.

Paid chat planModel on your PC
Each monthThe plan price, for light use and heavy use alike.Electricity for the hours the machine is under load.
To get startedAn account with the provider.A computer that can hold the model. A machine you already have adds no purchase to this sum.
Where it runsOn the provider's computers. It needs a connection.On your computer. A model you have downloaded runs offline in Ollama and LM Studio.
LimitsThe provider sets message or usage limits, and changes them. Read the current plan.Those apps do not meter tokens for a model running on your computer. The limit is the memory and speed of your hardware.

A home model and a cloud plan are different products. Models that fit on a home PC are smaller than the largest cloud models, which still lead on hard tasks. A local prompt is processed on your machine. Why run AI locally? covers where that privacy holds, and where an app can still send data out.

Already owned. The purchase is behind you. The extra money is the electricity while a model is generating. At the assumptions on this page, a mid-range desktop card used for two hours a day is a few dollars a month.

Buying. The price of the graphics card or the mini PC is the large part. Electricity still applies on top. The payback further down divides a stand-in purchase price by the monthly plan you would stop paying, after electricity. It counts as money saved only when you would have paid that plan and then cancelled it.

Power under load

The watts below are the manufacturers' rated power, published on their spec pages. Partner cards sometimes ship with a different power limit, so the GPU numbers here are NVIDIA's own specifications. A short chat can draw less than the rating. A long job can sit near it. This page does not report a lab measurement of one chat session.

A desktop GPU rating is the graphics card's power. The CPU, motherboard, drives and fans are extra, and a plug-in meter at the wall will read higher still, once the power supply's own losses are included. The Mac mini rating is a maximum for the whole computer, so it is a ceiling for that machine. The two kinds of number answer different questions, which is why the table says what each figure covers.

Laptop cards with the same name often use a lower power limit chosen by the laptop maker. The GPU rows are desktop ratings. For a laptop, use that machine's own limit, or a meter. More on laptops: Running local AI on a laptop.

Monthly energy assumes 2 hours a day at the rated watts and a 30-day month (60 hours). Monthly money uses the assumption NZ$0.30/kWh or US$0.15/kWh, rounded to the nearest cent. Half a cent rounds up.
MachineRated wattsWhat the watts coverkWh / monthNZD / monthUSD / month
GeForce RTX 4060 1 115 W Graphics card power. The card only. 6.90 NZ$2.07 US$1.04
GeForce RTX 4060 Ti 1 165 W Graphics card power. The card only. 9.90 NZ$2.97 US$1.49
GeForce RTX 3060 (12 GB) 2 170 W Graphics card power. The card only. 10.20 NZ$3.06 US$1.53
GeForce RTX 4090 3 450 W Graphics card power. The card only. 27.00 NZ$8.10 US$4.05
Mac mini with M4 (2024) 4 155 W Maximum continuous power for the whole computer. 9.30 NZ$2.79 US$1.40

A suggested power-supply size on a graphics-card spec is there for choosing a supply with spare room. Leave that number out of this sum. Use the graphics card power, or a wattage you measured.

The desktop cards are on the 8GB, 12GB, 16GB and 24GB hardware pages. The Mac mini is on the mini PC page. A PC you already have: Local AI on a budget PC. Choosing a small box: Choosing a mini PC for local AI.

As an Amazon Associate, Lila Forge earns from qualifying purchases. "Check price on Amazon" links on those hardware pages are affiliate links (rel="sponsored nofollow"). Buying through them costs you nothing extra.

Worked example

Assumptions you can change. Everything in this box is a stand-in for the arithmetic. Swap any of it in the calculator.

AssumptionNZD exampleUSD example
Electricity priceNZ$0.30 per kWhUS$0.15 per kWh
Hours at the rated power2 hours a day2 hours a day
Length of a month30 days30 days
Paid chat planNZ$34 a monthUS$20 a month
How NZ$34 relates to US$20US$20 × an assumed NZ$1.70 per US dollar. That rate is an assumption, and it is not a bank rate for any particular day.
Hardware you already ownNZ$0US$0
Hardware if you are buyingNZ$800 stand-inUS$500 stand-in

The plan prices are round figures so the sum has an input. OpenAI and Anthropic publish their own prices, and those prices change. Check ChatGPT pricing and Claude pricing (each opens in a new tab), then type the price on your bill. The hardware stand-ins are not shop prices.

Monthly money is the kilowatt-hours times the price, rounded to the nearest cent. Half a cent rounds up. A year in this example means twelve of those rounded months.

Desktop GPU, computer already owned

Take the GeForce RTX 4060 Ti rating of 165 W.1 The example holds the card at that power for 2 hours a day, for 30 days.

165 W × 2 hours × 30 days ÷ 1000 = 9.90 kWh in the month.

At the assumed NZ$0.30 per kWh, that is NZ$2.97 for the month, and NZ$35.64 over twelve such months.

At the assumed US$0.15 per kWh, that is US$1.485, which is US$1.49 to the nearest cent for the month, and US$17.88 over twelve such months.

The assumed plan costs NZ$31.03 more than this electricity in the NZD example, and US$18.51 more in the USD example. With hardware set to zero, that gap is the whole money comparison. It still leaves out the rest of the desktop, so a wall reading for the whole tower belongs in the calculator as a higher wattage.

Mini PC, at the published ceiling

The same hours and the same two electricity prices, with the Mac mini's 155 W maximum continuous power.4 155 W × 2 × 30 ÷ 1000 = 9.30 kWh. That is NZ$2.79 at NZ$0.30 per kWh, and US$1.395, which is US$1.40 to the nearest cent at US$0.15 per kWh. This rating is a ceiling for the whole M4 Mac mini (2024). A short chat can sit below it. An M4 Pro model has its own maximum on Apple's spec page.

A high-watt desktop card

The GeForce RTX 4090 rating is 450 W.3 At the same two hours a day that is 27.00 kWh, NZ$8.10 at NZ$0.30 per kWh, and US$4.05 at US$0.15 per kWh. The rest of that desktop is still extra. The same extra hours raise this card's electricity bill by more than they raise a 165 W card's. Type those hours into the calculator.

If you still have to buy the hardware

The purchase prices here are stand-ins: NZ$800 in the NZD example and US$500 in the USD example. They are not prices from a shop. Type the price you would actually pay.

Payback in this sum is the stand-in price divided by the monthly gap (the assumed plan minus the rounded electricity). For the 165 W card at two hours a day, that is NZ$800 ÷ NZ$31.03 = 25.8 months in the NZD example, and US$500 ÷ US$18.51 = 27.0 months in the USD example.

Those months are money saved only if you would have paid the plan and then stopped. A computer you use for other work is still a computer after the months are up. If you would keep the cloud plan for the hard tasks, the plan is not a saving to divide into.

Calculator

The boxes start on the worked example. The electricity price, the hours, the plan and the hardware price are assumptions. The watt presets are the sourced ratings from the table above. With JavaScript off, the worked example still stands.

Assumption. Choosing NZD fills 0.30 and choosing USD fills 0.15. Put the dollars-per-kWh figure from your bill in the box. Choosing a currency also refills the example plan price.

Assumption. The NZD example uses 34 and the USD example uses 20. NZ$34 is US$20 times an assumed NZ$1.70 per US dollar. Use the price on your plan.

Use 0 if you already own the computer. To match the buying example, type 800 in NZD or 500 in USD. Those stand-ins are not shop prices.

Results for your figures

Turn on JavaScript to recalculate. The worked example above uses these starting numbers.

What the sum leaves out

  • Idle power. The sources below do not give a wattage for the machine sitting idle, so this page adds none.
  • The rest of a desktop, for every GPU row. The Mac mini row is the whole computer, at its maximum.
  • Heat, noise and wear. No dollar amount is attached to those here.
  • Model licences. Some models restrict commercial use. Local AI for a small business is the page for that check.

Image generation and long jobs can sit at the rated power for more of the day than a short chat. The hours box is where that goes.

Sources for the power figures

The watts on this page come from the manufacturer pages below. The electricity prices, the two hours a day, the 30-day month, the plan prices, the NZ$1.70 exchange illustration, and the hardware stand-in prices are assumptions, so they have no source.

  1. NVIDIA, GeForce RTX 4060 family specifications. Graphics card power is 115 W for the desktop GeForce RTX 4060 and 165 W for the GeForce RTX 4060 Ti (8 GB and 16 GB). NVIDIA GeForce RTX 4060 family specifications (opens in a new tab).
  2. NVIDIA, GeForce RTX 3060 specifications. Graphics card power is 170 W for the desktop GeForce RTX 3060. NVIDIA GeForce RTX 3060 specifications (opens in a new tab).
  3. NVIDIA, GeForce RTX 4090 specifications. Graphics card power is 450 W. NVIDIA GeForce RTX 4090 specifications (opens in a new tab).
  4. Apple, Mac mini technical specifications, for the Mac mini with the M4 chip introduced in 2024. Maximum continuous power is 155 W for the whole computer. If that page has moved on to a newer Mac mini, 155 W is the figure Apple published for the M4 model. Apple Mac mini technical specifications (opens in a new tab).

Get the Local AI weekly

New models worth running, what fits which GPU, and setup fixes. One short email a week, free. Unsubscribe any time.

Subscribe free →

Lila Forge Kits

Local-LLM App Starter

A tested starter for building your own app on Ollama: chat, RAG and a GPU-fit checker. Skip the setup hours.

kits.lilaforge.com →
VibeEngine

Best local LLM tools, ranked

Ollama, LM Studio, Open WebUI and llama.cpp scored from public evidence, with top picks.

vibeengine.lilaforge.com →