method · first seen 6 Nov 2026
codebook audit
Pre-deployment review of annotation codebooks using class-specific metrics and confusion matrices to diagnose LLM annotation errors.
Mentions per week
PapersCodeDiscussion
Earliest sources
- When F1 Is Not Enough: Auditing Codebooks for LLM-Assisted AnnotationPapers · 6 Nov 2026 · Yuehong Cassandra Tai, Qunhua Li
Latest sources
- When F1 Is Not Enough: Auditing Codebooks for LLM-Assisted AnnotationPapers · 6 Nov 2026 · Yuehong Cassandra Tai, Qunhua Li