Local Web-Search Assistant Running Entirely Offline Models

AI products · Creator, sole engineer · shipped

Quick factual questions usually need a web search plus reading three pages.

The detail

This is a terminal assistant that searches the web for a query and summarises the results using a language model running entirely on your own machine. No query content reaches a model provider.

A compact demonstration of combining a search API with local inference through an orchestration framework - the same pattern that scales up to full retrieval systems, at a size where the whole thing is legible.

Python, LangChain, Ollama, Tavily Search.

What I did

  • Built a terminal assistant that searches the web and summarises results using a locally-run model
  • Integrated a search API with a local inference runtime through an orchestration framework
  • Kept all inference local so no query content reaches a model provider

Stack

Python, LangChain, Ollama, Tavily, Local AI, CLI Development

Case study: https://www.siddhvasudev.com/projects/local-web-search-assistant-running-entirely