Offline Desktop AI Assistant Running a Local Language Model
Apps & experiments · Creator, sole engineer · shipped
Asking a quick question to an AI means switching windows, which breaks flow - and cloud assistants need an API key and a connection.
Code: https://github.com/vasu-devs/Korosuke
The detail
This is a sidebar that slides in from the screen edge, answers, and slides away. Every response comes from a language model running locally on your own machine, so it works offline with no account and no keys.
The engineering point is concurrency. A desktop UI framework blocks its event loop on synchronous inference, freezing the window mid-generation, so generation runs on a background worker thread and streams back to the interface. Without that the app is unusable.
Toggling is process-based: running the same shortcut again flips visibility rather than launching a second instance, which avoids needing a background daemon at all.
Python, PyQt5, Ollama.
What I did
- Built a sliding sidebar desktop assistant with smooth animation and styled chat rendering
- Ran inference on a background thread so the interface never freezes during generation
- Implemented process-based hotkey toggling so one shortcut both shows and hides the panel with no daemon
- Made it work fully offline against a local model with no API keys
Stack
Python, PyQt5, Ollama, Desktop Application, Concurrency, Local AI
Case study: https://www.siddhvasudev.com/projects/offline-desktop-ai-assistant-running-a