Connecting a private Obsidian vault to Ollama on macOS
What they built
The author wanted AI summaries and answers about content in Obsidian, but the vault holds lots of private meeting notes, so connecting it to public services was out. They couldn't find an easy guide, so they wrote one.
They first installed Private GPT, then found the Obsidian plugins could talk to Ollama directly.
Setup
- macOS with Homebrew
- Ollama with llama3.1 and nomic-embed-text
- Obsidian plugins: Local GPT and AI Providers
- (Optional) Private GPT, which needs Python 3.11, not 3.13
Gotchas
- Private GPT turned out to be unnecessary for Obsidian
- Local GPT has no context menu out of the box; bind a hotkey to 'Local GPT: Show context menu'
Do it yourself
- Install Ollama and pull the models
- In AI Providers add an Ollama provider at http://127.0.0.1:11434 and pick llama3.1:latest (plus nomic-embed-text)
- In Local GPT set the Main and Embedding providers
- Bind a hotkey (author used OPT+CMD+G) to the Local GPT context menu
- Run Ollama persistently with brew services
brew install ollama
ollama pull llama3.1
ollama pull nomic-embed-text
brew services start ollamaRelated
A private ChatGPT for a family of four on a Mac mini
One always-on M4 Mac mini serves Open WebUI to every phone and laptop in the house. Kids get a tutor preset, and three AI subscriptions are gone.
Offline RAG over 268 Obsidian notes, queryable from a coding agent
nomic-embed-text, ChromaDB and mistral-nemo:12b give cited answers from a vault of internal docs, and an MCP server lets the coding agent search it too.
mdrag: a Rust CLI to chat with an Obsidian vault
A self-contained RAG tool built on SQLite with sqlite-vec and gemma3:1b. It answers 'how did I fix that Git submodule issue?' from your own notes.
Mac Studio as an always-on, LLM-driven smart-home brain
Phrases like 'it's stuffy in here' become real device calls, run by Ollama with qwen3:14b on a Mac Studio. €15 ESP32 satellites keep all audio on the LAN.