Local AI use cases with Phi
Phi is Microsoft's family of small language models. Models like Phi-3 mini and Phi-4 mini are compact enough for laptops and single-board computers.
Rebel BitesOffline LLM on a Raspberry Pi 5 for classification and extraction
Phi-3 mini at Q4_K_M runs at 4-6 tokens per second on an 8 GB Pi 5 with no network at all. Under GDPR, data that never leaves the board isn't transferred anywhere.