Local Web-Search Assistant Running Entirely Offline Models
AI products · Creator, sole engineer · shipped
Quick factual questions usually need a web search plus reading three pages.
The detail
This is a terminal assistant that searches the web for a query and summarises the results using a language model running entirely on your own machine. No query content reaches a model provider.
A compact demonstration of combining a search API with local inference through an orchestration framework - the same pattern that scales up to full retrieval systems, at a size where the whole thing is legible.
Python, LangChain, Ollama, Tavily Search.
What I did
- Built a terminal assistant that searches the web and summarises results using a locally-run model
- Integrated a search API with a local inference runtime through an orchestration framework
- Kept all inference local so no query content reaches a model provider
Stack
Python, LangChain, Ollama, Tavily, Local AI, CLI Development
Case study: https://www.siddhvasudev.com/projects/local-web-search-assistant-running-entirely