Local & private AI for edge

Running models on small, low-power devices like single-board computers, often fully offline.

1 real example, each linked to its original source.

SponsorsAdvertise here

Offline LLM on a Raspberry Pi 5 for classification and extraction

Phi-3 mini at Q4_K_M runs at 4-6 tokens per second on an 8 GB Pi 5 with no network at all. Under GDPR, data that never leaves the board isn't transferred anywhere.

Stefano Noferi