AI Shopping Assistant Passing 54/54 Evaluation Gates
Client work · AI Engineer · deploy-ready
Conversational shopping is not a search problem. A single sentence like 'something for a summer wedding, under budget, and I hate florals' contains an occasion, a price ceiling, a negative style constraint and an implied formality level. Keyword search returns nothing useful, and a naive AI either interrogates the shopper with a dozen questions or recommends products that do not exist.
The detail
I built the assistant backend: one orchestrator composing specialised components for routing, search, outfit building, vision, memory and trends. Each message routes to exactly one action and returns a single structured response the app renders directly.
Retrieval is hybrid - keyword matching for explicit brand and category mentions, vector search for intent - over a catalogue enriched offline by a vision pipeline that tags every product image with style, occasion, season, fit and formality.
The key product decision was a strict question budget with an act-first decision ladder. Conversational shopping dies if the assistant plays twenty questions, so it makes a best-effort recommendation and states its assumptions instead.
272 unit tests, 54 of 54 deterministic evaluation gates passing, and 57 live QA scenarios against a 12,700 product catalogue.
What I did
- Built the entire conversational backend and its evaluation suite
- Designed the orchestrator composing specialised components with single-action routing per turn
- Implemented hybrid keyword and vector retrieval over a vision-enriched catalogue
- Built the offline vision enrichment pipeline tagging products by style, occasion, season, fit and formality
- Designed the question-budget decision ladder that forces action over interrogation
- Shipped visual search as a quantised model so production carries no heavy ML framework
- Wrote 272 unit tests, 54 deterministic evaluation gates and 57 QA scenarios
- Produced the deployment runbooks, architecture docs and API collection
Stack
Python, FastAPI, LLM Prompt Engineering, MongoDB, AI Agent Development, Vector Search, CLIP, ONNX, Redis, LLM Evaluation, Docker
Case study: https://www.siddhvasudev.com/projects/ai-shopping-assistant-passing-54-54