Socratis: AI Voice Interviewer That Sees Every Keystroke

AI products · Creator, sole engineer · shipped

An AI that conducts live coding interviews over voice while watching the candidate's editor in real time.

Code: https://github.com/vasu-devs/Socratis

The detail

Earlier versions hallucinated about code they had never actually received - praising bugs and inventing complexity analysis. The fix was explicit context injection: every edit in the editor pushes a system message into the agent's context, so the model literally sees each change instead of guessing from conversation.

The agent is deliberately quiet. It speaks only when it detects a bug, a change of approach, or a stall, and it hints rather than solves. An interviewer that talks constantly is worse than none.

Afterwards it runs a second pass and produces a forensic report: strict time and space complexity, line-by-line fixes, communication analysis citing exact transcript quotes, and a check that cross-references what the candidate claimed verbally against what their code actually does.

Next.js, Python, LiveKit, Deepgram, Groq, Monaco Editor, Express, MongoDB.

What I did

  • Built the voice agent, the coding interface, the backend and the reporting pass
  • Solved the hallucination problem with explicit editor-context injection on every keystroke
  • Designed the intervention rules so the agent speaks only on bugs, stalls or approach changes
  • Built the forensic post-interview report with complexity analysis and line-level fixes
  • Implemented the claim-versus-code cross-check that catches candidate overclaims

Stack

Voice Assistant, Next.js, Python, AI Agent Development, MongoDB, LiveKit, Deepgram, Monaco Editor, Express, WebRTC

Case study: https://www.siddhvasudev.com/projects/socratis-ai-voice-interviewer-that-sees