Procurement Guide13 min read·Human Consensus AI Team

How to Run an AI Annotation Pilot: Checklist and Success Criteria for RLHF and LLM Teams

You've written your annotation brief, evaluated vendors with your RFP and scoring rubric, and selected a vendor. Now comes the step most teams skip, rush, or treat as a rubber stamp: the calibration pilot. This guide covers how to design and run a pilot that actually tells you whether to proceed — with a 10-item checklist, four success metrics, a calibration session agenda, and a go/no-go decision framework.

1. Why Pilots Fail (and Why Most Teams Skip Them)

Most ML teams treat the annotation pilot as a rubber stamp. They send a vendor 50 easy examples, the vendor returns them quickly with high apparent agreement, and the team proceeds to production. Six weeks later, 25% of their reward model training data is inconsistently labeled and they're debugging an unexplained performance cliff on edge cases.

Two specific failure modes explain most pilot failures — and they are structural, not accidental:

Pilot task set not representative of production distribution

Teams default to easy examples for the pilot — well-formed prompts, clear preference signals, no ambiguity. The vendor passes because the pilot was easy. In production, 20–30% of the task set involves genuine edge cases: ambiguous outputs, multi-turn context, conflicting quality dimensions. The vendor who sailed through the pilot now has κ = 0.48 on the hard tasks. The pilot told you nothing real.

No IAA measurement during the pilot

Some teams run a pilot but don't measure inter-annotator agreement — they review a sample visually and approve if it "looks good." Visual review is not a quality measure. A vendor can deliver consistent-looking annotations with κ = 0.55, where annotators have developed informal conventions that look coherent but don't reflect your rubric. Without IAA measurement against a ground truth set, the pilot gives you a subjective impression of quality, not a data-backed signal.

The cost of skipping a well-designed pilot is concrete. A 10–30% rework rate on a production annotation run translates directly to budget and timeline: $5,000–$50,000 in retraining costs on the GPU side, and a 4–8 week timeline hit before you can restart production with corrected data.

The pilot as an insurance policy

A properly designed pilot costs $500–$2,000 in annotation fees and 5 business days. Discovering a quality problem after committing to production costs $20,000–$100,000 in rework, retraining, and timeline recovery. The pilot is not a nice-to-have — it's the cheapest insurance policy in your annotation budget.

2. What a Good Pilot Looks Like: The 5 Design Principles

A well-designed pilot is not a small production run. It is a structured quality validation exercise with specific design constraints. Five principles determine whether a pilot actually validates vendor quality or just validates that easy tasks are easy.

01

Representative sampling

The pilot task set must match your production distribution — including edge cases. If 20% of your production tasks are genuinely ambiguous examples, 20% of your pilot tasks should be too. The most common design mistake is giving vendors a clean, easy pilot set to avoid confusion. This produces a misleadingly high pilot score and a vendor who fails on the exact tasks you most need them to handle correctly.

02

Blind IAA measurement against ground truth

Your pilot must include examples that your team has already labeled internally — the ground truth set. IAA must be measured against that ground truth, not just between vendor annotators. In-vendor IAA measures annotator consistency with each other, which can be gamed (annotators learn each other's conventions). Ground truth IAA measures vendor accuracy against your actual quality standard, which cannot be gamed without knowing which examples are ground truth.

03

Volume formula

Use the formula: pilot_size = max(50, 5% of planned production volume). For a 1,000-pair production run, pilot 50 pairs. For a 5,000-pair run, pilot 250 pairs. This minimum ensures statistically stable κ estimates — below 50 examples, κ confidence intervals are too wide to draw reliable conclusions. Above 5%, you're spending more on the pilot than the quality gate warrants.

04

Calibration session before annotation begins

Every pilot must begin with a 1-hour synchronous calibration session reviewing 5–10 genuinely ambiguous examples from your real data. This session aligns annotators on rubric interpretation before they touch the pilot set. Vendors who skip the calibration session and proceed directly to annotation are making assumptions about your rubric that may or may not match your intent — and you won't discover the mismatch until you review IAA scores.

05

No cherry-picking pilot results

Pilot IAA must be calculated on the full pilot set — not on a curated subset of "good examples" the vendor selects for reporting. Some vendors will deliver the full pilot but report IAA only on the high-agreement subset. Require full-set IAA reporting as a contractual condition. Any vendor who resists this condition is telling you something important about their typical quality distribution.

3. The 10-Item Pre-Pilot Checklist

Before you hand a single task to a vendor, every item on this list should be confirmed. Each one represents a downstream failure mode if it's missing.

1

Annotation brief is finalized and sent

The brief — task definition, rubric with anchors, edge case handling, IAA targets, annotator requirements — is complete and has been sent to the vendor before the pilot begins. A vendor annotating without a complete brief is guessing. See our complete annotation brief guide for the full template.

2

Ground truth batch is prepared

50–100 internally labeled examples, covering diverse task distribution including edge cases. These examples are mixed into the pilot set and not identified as ground truth to the vendor. Without a ground truth batch, you cannot measure vendor accuracy — only vendor internal consistency.

3

IAA target is set by dimension

Cohen's κ thresholds are defined for each rubric dimension individually, not as a single overall target. Example: κ ≥ 0.70 for preference selection, κ ≥ 0.75 for helpfulness rating, κ ≥ 0.85 for safety flags. A single overall threshold obscures dimension-level failures — a vendor can average κ = 0.72 while κ = 0.45 on your most sensitive dimension.

4

Pilot task set is designed

The pilot set is assembled to match production distribution, including representative edge case proportion. It is not drawn from the easiest examples in your dataset. If you don't have a designed pilot set, a vendor passing the pilot proves nothing about production readiness.

5

Calibration session is scheduled

A 1-hour synchronous session is scheduled before annotation begins — not after, not concurrent with the pilot. The session reviews genuinely ambiguous examples from your data, aligns rubric interpretation, and confirms the escalation path. Vendors who skip this are guessing on your rubric.

6

Pilot timeline is defined

Maximum 5 business days from calibration session completion to pilot delivery. A pilot that takes longer than 5 business days indicates an operational issue: annotator availability problems, ambiguous task design that generates excessive questions, or a vendor over-committed on other projects. Timeline length is itself a signal.

7

Escalation path is defined

When annotators encounter a genuinely ambiguous case that the rubric doesn't resolve, who do they escalate to? What is the SLA for escalation responses? Without a defined escalation path, annotators will guess rather than flag — and guesses on genuinely ambiguous tasks are exactly the data quality problem you're trying to prevent.

8

QA protocol is defined

Spot-check percentage (minimum 20% of pilot examples), who reviews disagreements (your team, a senior annotator, or both), and how disagreements are resolved before final delivery. The QA protocol determines whether the pilot data you receive is raw annotation output or reviewed output.

9

Acceptance criteria are defined in advance

The specific κ threshold per dimension at which you will proceed to production — agreed with the vendor before the pilot begins, not negotiated after you see results. Post-hoc acceptance criteria negotiation is how vendors talk ML teams out of pilot failures. Set them in advance, in writing.

10

Data security requirements confirmed

NDA is executed, data handling protocol is agreed (transmission method, storage location, deletion on project completion), and any applicable compliance requirements (HIPAA BAA, GDPR DPA) are in place. For production RLHF data containing real user queries, this is not optional overhead.

Need an annotation pilot scoped quickly?

Send us your annotation brief and we'll scope a calibration batch within 48 hours — IAA measurement, ground truth comparison, and calibration session included.

View Starter Pack — $49 →

4. Measuring Pilot Success: The 4 Metrics That Matter

Four metrics determine whether a pilot passes. A vendor who passes on all four has demonstrated the quality controls you need for production. A vendor who passes on fewer is giving you information about where the risk is — not permission to ignore it.

Metric 1: Inter-Annotator Agreement (IAA / Cohen's κ) by dimension

IAA must be measured per dimension, not as a single overall number. Overall κ averages away dimension-level failures — a vendor can meet your overall threshold while failing catastrophically on a single dimension that matters most to your reward model.

Task typeMinimum κ targetRationale
RLHF preference pairs≥ 0.70Below this, annotators disagree on 1 in 4 pairs — reward model learns noise
SFT instruction quality≥ 0.75Higher bar because poor completions directly degrade SFT examples
Safety / toxicity classification≥ 0.85High-stakes decisions require near-consensus; misclassification risk is asymmetric

What κ < 0.60 means in practice: annotators agree on fewer than 3 in 4 examples after accounting for chance agreement. On RLHF preference pairs, this means roughly 1 in 4 preference signals is a coin flip. A reward model trained on this data will learn a noisy, inconsistent signal — and you won't see the quality problem until you evaluate the trained model.

For a deeper guide to IAA measurement and what these scores mean for RLHF quality, see our post on domain expert annotators vs. crowdsourcing.

Metric 2: Ground truth accuracy

Ground truth accuracy measures how often the vendor's annotations match your pre-labeled internal examples. This is the honest quality signal because it removes in-vendor IAA gaming — a vendor who has developed informal internal conventions can show high annotator-to-annotator agreement while being consistently wrong relative to your actual quality standard.

Target: ≥ 85% ground truth match rate on the mixed-in ground truth subset. Below 80%, the vendor is misinterpreting your rubric at a rate that will corrupt production data. Below 75%, reject and move to the next vendor.

Ground truth accuracy also diagnoses where annotation failures are systematic vs. random. If the vendor consistently mis-classifies a specific type of edge case, that is a calibratable problem. If failures are distributed randomly across the task set, it is a workforce quality problem.

Metric 3: Calibration convergence

Split the pilot into quarters and measure IAA on the first 25% vs. the last 25%. A vendor who is learning your rubric will show improving κ across the pilot — early examples have lower agreement, later examples have higher agreement as annotators internalize the criteria.

A vendor who shows flat or declining calibration convergence is not improving on your rubric, which means the annotation is driven by annotator intuition rather than systematic rubric application. This is a structural quality problem — it cannot be fixed by running more production volume, because more volume just produces more of the same inconsistent signal.

Minimum acceptable convergence: κ in the last 25% of the pilot should be ≥ 10% higher than κ in the first 25%. A vendor who starts at κ = 0.65 and ends at κ = 0.72 is demonstrating calibration. A vendor who starts at κ = 0.65 and ends at κ = 0.64 is not calibratable on this task.

Metric 4: Edge case handling rate

In your pilot set, include 10–15% of tasks that are genuinely ambiguous — examples where your rubric provides insufficient guidance to make a confident judgment and where the correct annotation is to escalate.

Track: what percentage of edge cases did the vendor escalate (as instructed) vs. annotate without flagging? A vendor with a functioning escalation culture will escalate 60–80% of genuinely ambiguous edge cases. A vendor who annotates all edge cases without escalation is making low-confidence guesses and hiding them in the delivery — you won't know which annotations are high-confidence labels and which are guesses.

Escalation rate is a leading indicator of production data integrity. Good vendors escalate; bad vendors guess and deliver.

5. How to Run the Calibration Session

The calibration session is the most important hour in your vendor relationship. It sets rubric interpretation before any annotation occurs — aligning annotators on edge cases before they develop inconsistent informal conventions. A well-run calibration session prevents most of the quality problems that show up in IAA scores three days later.

60-Minute Calibration Session Agenda

0–10 min

Setup and introductions

Confirm attendees (your team lead, vendor project manager, and at least 2 annotators who will work on the pilot). Verify everyone has read the annotation brief. Confirm the escalation path and point of contact for questions during the pilot.

10–30 min

Review 5 genuinely ambiguous examples

Walk through 5 examples drawn from your real data — not constructed examples, not easy cases. Each example should be one where your rubric leaves genuine ambiguity. Ask annotators to articulate their reasoning, not just their answer. Look for consistency in how they apply the rubric, not just what answer they land on.

30–50 min

Q&A on rubric edge cases

Open the session for annotator questions. The questions annotators ask reveal where the rubric is ambiguous, where they have prior experience that may not match your intent, and where they are likely to diverge on production tasks. Every question answered in this session is a disagreement avoided in the pilot.

50–60 min

Align on escalation path

Confirm: What is the threshold for escalation (when should an annotator flag rather than annotate)? Who receives escalations? What is the SLA for response? Walk through one example of an escalation scenario so annotators understand what a legitimate escalation looks like vs. an annotation they should make with stated uncertainty.

During the session, watch for three categories of signal:

  • Annotators who ask clarifying questions about edge cases — good sign. They're reading the rubric carefully and probing for gaps.
  • Annotators whose rubric interpretations converge on the ambiguous examples after discussion — good sign. They're calibratable.
  • Annotators who push back on criteria they find ambiguous — good sign. They're identifying exactly the rubric gaps that will cause pilot failures.

Three red flags in the calibration session:

No questions about edge cases

Annotators who complete the calibration session without asking a single substantive question about rubric ambiguity haven&apos;t found the hard parts yet — or they&apos;re not reading carefully enough to find them. Either way, they&apos;ll produce inconsistent annotations on the edge cases they haven&apos;t asked about.

Annotators who say they've seen this before and don't need the examples

Overconfidence in a calibration session is a red flag, not a green one. Annotators who believe their prior experience maps perfectly to your task aren&apos;t calibrating to your rubric — they&apos;re applying a prior that may or may not match your criteria. The rubric exists to override default assumptions; annotators who dismiss it are a quality risk.

Vendor project manager who promises a specific κ without seeing the data

Any vendor who commits to "we&apos;ll hit κ = 0.75" before running the calibration session is making a sales claim, not an operational commitment. IAA on a new task type is not knowable without seeing the actual task distribution and rubric. A vendor who knows their methodology well will say: "On comparable tasks we&apos;ve achieved κ = 0.70–0.78; we&apos;ll confirm target feasibility after the calibration session." Pre-calibration κ promises are a signal that the vendor is selling, not scoping.

6. Pilot Debrief: Go/No-Go Decision Framework

When pilot results come in, you have exactly three outcomes available. The framework below prevents the most common failure mode: treating a marginal pilot as a pass because you've invested time in the vendor relationship and don't want to start the selection process again.

Proceed to production

κ ≥ target across all dimensions AND ground truth accuracy ≥ 85%

Document the calibration protocol, annotator team composition, and task spec that produced these results. Explicitly request the same annotator team for production — calibration is annotator-specific, not vendor-wide. Proceed with milestone-based IAA monitoring: measure κ at the end of each production batch and flag any batch that falls below threshold before delivering the next.
~

Conditional proceed — root cause first

κ within 10% of target (e.g., target 0.70, actual 0.64–0.69) OR 1–2 dimension misses

Identify the root cause before proceeding. Three possible sources: (1) Rubric ambiguity — the dimension that missed has criteria annotators interpreted differently. Fix: add concrete examples to the rubric, run a 50-example re-pilot on that dimension only. (2) Pilot design — edge case proportion was too high and exceeded what the rubric covers. Fix: adjust the brief and re-pilot the failed dimension. (3) Vendor quality — annotators are not capable of reaching the threshold on this dimension regardless of rubric clarity. Fix: reject the vendor for this dimension. Distinguish between the first two (solvable) and the third (not solvable) before deciding.

Reject — move to next vendor

κ more than 10% below target (e.g., target 0.70, actual < 0.60) OR ground truth accuracy < 75%

A κ gap of more than 10 percentage points, or a ground truth match rate below 75%, indicates a structural quality problem — not a calibration gap. You cannot train an annotation workforce to hit your threshold through additional calibration when the gap is this large. The most expensive mistake ML teams make is running a second pilot with the same vendor after a clear rejection result. Document the rejection reasoning and move to the next vendor on your shortlist.

Worked example

Project: 5,000 RLHF preference pairs. Pilot: 250 pairs over 5 business days.

Pilot results: κ = 0.68 (helpfulness) / 0.71 (harmlessness) / 0.64 (formatting). Ground truth accuracy: 87%.

Outcome: Helpfulness and harmlessness pass (target 0.70 — helpfulness is within 10%). Formatting misses by 6 points.

Root cause analysis: Review the formatting dimension disagreements. The rubric says "well-formatted response" but provides no examples distinguishing markdown headers from bullet points from prose in different contexts. Annotators are applying different intuitions.

Fix: Add 3 concrete format examples to the brief — one example each of high-quality, medium-quality, and low-quality formatting for the prompt types in this dataset. Schedule a 20-minute follow-up calibration call on formatting criteria only.

Re-pilot: 50 pairs on the formatting dimension only. κ = 0.73. Proceed to production.

For more on how annotation quality at scale interacts with RLHF reward model training at 10,000+ annotations, see our practitioner guide on scaling human feedback pipelines.

7. How Human Consensus AI Handles Pilot and Calibration

We'll be direct about what our process looks like, and equally clear about where we're not the right fit.

What's built into our process

  • Calibration batch as standard practice: Every project begins with a calibration batch — it is not optional and not priced separately. We don't offer production annotation without prior calibration because our methodology requires it.
  • Domain expert matching before pilot begins: We match annotators to your task domain before the calibration session, not after. If your project requires medical knowledge, legal background, or software engineering expertise, the pilot pool reflects that before annotation starts.
  • IAA measurement included in project pricing: IAA reporting per batch is included in every project price. No hidden QA costs, no per-batch reporting fees. You get κ by dimension on every delivery.
  • Ground truth comparison available on request: If you provide a ground truth set as part of the pilot design, we'll measure accuracy against it and include the results in your pilot report at no additional cost.

Not right for

  • Large enterprise teams with existing annotators: If you need BYO-workforce tooling — a platform where your existing annotator pool works — we're not the right solution. We supply the annotators; we don't tool other workforces.
  • Commodity 100K+ volume where calibration overhead exceeds value: For high-volume commodity annotation (bounding boxes, NER, binary classification at scale), calibration overhead is a real cost that may not be justified. Our methodology is built for expert annotation where quality is the constraint, not throughput.

For comparison with other vendors on pilot and calibration practices, see our roundups: Scale AI alternatives, Labelbox alternatives, and Appen alternatives. For context on annotation budget planning, see our AI annotation pricing guide.

Ready to start a pilot?

Send us your annotation brief and we'll scope a calibration batch within 48 hours. We'll confirm your IAA targets, match domain experts to your task, and deliver a fixed-price pilot proposal — calibration session, ground truth comparison, and IAA reporting included.

Run a pilot that actually validates vendor quality.

Our Starter Pack is designed for annotation pilots: domain experts, built-in calibration session, IAA measurement per delivery, and a fixed price. Send us your brief and we'll scope the pilot within 48 hours.

Start the Pilot — Starter Pack $49 →

Scoping a larger annotation program? The Enterprise Bundle includes custom rubric design, dedicated domain expert sourcing, full calibration management, and per-batch IAA monitoring — without six-figure contract minimums.

View Enterprise Bundle — $299 →