01
Question set (gold set)
Built from your documents, stratified so a pass is not just "the model said no".
Your enterprise buyer will ask how you know your AI answers are correct. In four business days you get the answer in numbers: a test set built from your own content, the failure list, the fixes ranked by risk, and a harness your engineers re-run on every release.
The Go-Live Evidence Pack is a fixed-scope evaluation of one AI feature against one corpus. It measures what your buyers will ask about, writes down every number with its sample size, and hands over the code that produced it.
Product, corpus, the questions your buyers ask, your release date, one named owner. Scope confirmed in a one-page SOW.
Up to 60 questions written from your documents and your real user questions. You confirm five samples.
Retrieval, citation and groundedness measured. One agreed change applied and re-measured. Failure taxonomy finalised.
Scorecard, dossier, harness, a 30-minute readout, and fixes ranked by risk. Owner signs acceptance.
Built from your documents, stratified so a pass is not just "the model said no".
Recall@5, context precision, citation correctness, grounded-answer rate, refusal correctness.
Counted causes with question ids — not a list of adjectives.
One guardrail or configuration change, agreed at kickoff, measured twice.
Open-source stack, no licence fees. Your engineers re-run it themselves on every release.
Scorecard, method note, failure register, fix list, evidence index — one document a buyer can read.
These are the published results of a 50-question run over eight public Nigerian health-regulation documents. The retrieval layer is the weak one, and the pack says so: recall@5 is 0.379. The safety layer held — 25 of 25 unanswerable questions refused, zero visible hallucinations.
Every cell carries its n and its source file. That is the standard the pack is held to, including when the number is unflattering.
Download the sample pack↓No discovery project, no retainer to start, no proposal that takes a week to arrive. If the first three days are not useful, you pay nothing.
What the feature does, what your buyers are asking, and whether a mirrored corpus is possible. If it is not a fit, I say so on the call.
Scope, corpus, question count, dates, price and the exclusions — sent within two hours of the call. Signed, then work starts.
Scorecard, dossier, harness, readout. You keep the harness whether or not you ever buy anything else from me.
Up to 300 documents, 60-question gold set, full metrics, failure taxonomy, a two-page scorecard, and a 30-minute readout. Four business days. 100% before start, or 50/50 if your process requires it.