2025 · LLM Evals
NovaNet Eval Harness
AI support agent with production-grade LLM evals
A customer-support RAG agent wrapped in a full evaluation pipeline — 100-case golden dataset, deterministic assertions plus LLM-as-judge grading, hash-keyed response caching, and a GitHub Actions quality gate that blocks bad prompt changes before merge. Baseline evals caught an intermittent prompt-injection vulnerability. Ships with a Next.js metrics dashboard: run trends, per-case judge verdicts, grounded chat and a rendered knowledge base.
100-case golden dataset, CI-gated
FastAPI / LangGraph / Groq Llama 3.3 / Chroma / LLM-as-Judge / GitHub Actions / Next.js
