Local & private AI for offline

Setups that keep working with no internet connection at all.

2 real examples, each linked to its original source.

Sponsors
Rebel Bites+Your tool here
Advertise here

Offline chat on desktop or Android via Termux with Prefrontal

A privacy-first chat UI that works with Ollama on desktop or llama.cpp anywhere, including Android through Termux. No telemetry, no subscriptions.

llama.cppOllamaTermuxGemma#mobile#chat#offline
GitHub

Offline LLM on a Raspberry Pi 5 for classification and extraction

Phi-3 mini at Q4_K_M runs at 4-6 tokens per second on an 8 GB Pi 5 with no network at all. Under GDPR, data that never leaves the board isn't transferred anywhere.

llama.cppOllamaRaspberry PiPhi#edge#offline#privacy#data-extraction
Stefano Noferi