Quick answer
Download an open model such as Inkling 2 Mini with a local app like Ollama, then switch off web search and any cloud features, and paste in your private text. Because the model runs on your own computer, your documents don’t go to an AI company’s servers. To be sure, test it with Wi-Fi turned off. Use it for drafting, summarising and organising, and check facts, because small models know less than big cloud ones.
Key takeaways
- Local means your text stays on your machine, as long as the app and its add-ons don’t connect to the internet.
- Test with Wi-Fi off to prove it really works offline.
- Great for drafting and summarising private material; weaker on facts.
- Your computer still needs protecting. Local doesn’t mean secure if your laptop isn’t.
📘 Main article: This guide follows our Inkling 2 Mini Review: Can a 26B Local AI Model Beat Qwen 3.8 27B?. Thinking Machines showed the model running on a MacBook in aeroplane mode.
Many people hold back from using AI on client contracts, staff records or financial notes because they don’t want that material on someone else’s servers. Local AI models are a practical answer. Thinking Machines even demonstrated Inkling 2 Mini building a flight simulator on a laptop in aeroplane mode.
Why use a local AI model for private work?
- Privacy: your text isn’t sent to an AI provider.
- No usage limits or per-token bills once it is set up.
- Works anywhere: on a train, a plane or with poor Wi-Fi.
- Easier compliance conversations with clients who don’t want their data in cloud AI tools. Always check your own contracts and data protection duties.
Which tasks suit an offline model?
| Good fit | Less suited |
|---|---|
| Summarising contracts or reports you can’t share | Up-to-date facts or news |
| Drafting replies to sensitive emails | Long, many-step research |
| Tidying notes, lists and spreadsheets | Tasks needing the very best reasoning |
| Turning meeting notes into action points | Anything you won’t check before using |
How do you set up a private offline workflow?
- Check your hardware. Inkling 2 Mini needs a Mac with 32GB or more memory. Smaller models run on less; see How Much Memory Do You Need to Run an Open-Weight AI Model?.
- Install a local app and model. Follow How to Run Inkling 2 Mini on Your Mac With Ollama.
- Do the download while online. After that, you won’t need the internet.
- Make a private work folder for documents you will use with the model.
- Save a few reusable prompts, such as “Summarise this contract in plain English and list any deadlines, payments and notice periods.”
How do you make sure nothing leaves your computer?
- Turn off Wi-Fi and try a prompt. If it still answers, the model is running locally.
- Switch off web search or “online” features in any chat app you use with the model.
- Check which model is selected. Some apps mix local and cloud models; make sure a local one is chosen.
- Be careful with add-ons and plugins that connect to email, cloud drives or other services.
- Keep your computer secure: a strong password, disk encryption (FileVault on Mac) and up-to-date software.
⚠️ Warning: Only use the official model or trusted versions. Unofficial “uncensored” or modified copies may behave unpredictably; see Uncensoring an AI Model: What Mark Kashef’s /unlock Skill Really Does, and the Risks.
What are the limits of local AI?
- Fewer facts: small models know less and can make things up. Verify names, figures and dates.
- No live information while offline.
- Hardware cost: the best local models need a well-specified computer.
- Slower on long documents than cloud tools, depending on your machine.
Your next step: pick one private document you’ve avoided putting into AI, set up a local model, turn off Wi-Fi and ask it for a plain-English summary. Then check the summary against the original.
Frequently asked questions
Is a local AI model completely private?
The model itself runs on your computer, so your text isn’t sent to an AI company. Privacy also depends on the app’s settings, any add-ons and your computer’s security.
Can a local model use the internet?
Only if the app gives it web search or other online tools. Turn those off for private work.
Do I need an expensive computer?
For Inkling 2 Mini, you need a Mac with at least 32GB of memory. Smaller models can run on more modest machines.
Is local AI as good as ChatGPT or Claude?
Not for everything. The best local models are strong at coding and structured tasks but know fewer facts than large cloud models.
The bottom line
Local models like Inkling 2 Mini make it realistic to use AI on work you’d never paste into a cloud chatbot. Set it up once, prove it works with Wi-Fi off, keep your computer secure and check the output. You keep both the privacy and the productivity.
Related posts
- Inkling 2 Mini Review: Can a 26B Local AI Model Beat Qwen 3.8 27B?
- How to Run Inkling 2 Mini on Your Mac With Ollama
- Mac, NVIDIA or Your Old Computer: Which Should Run Your AI Agents?
