- Work from
- Australia, Canada, China, United States
- Contract
- Contract
- Salary
- $27 / hour
- Posted
- 22 November 2026
- Apply by
- 21 January 2027
Responsibilities
- Review annotators’ ACCEPT/REJECT decisions and reject reason codes, with a focus on preventing false matches and false rejects.
- Sample-check or fully review high-risk rows (multiple codes, OTHERS, rows with uncertainty notes).
- Correct errors, give feedback to annotators, and identify recurring error patterns to keep rule interpretation consistent.
- Compile questions for the client where rules are ambiguous, and maintain a clarification log.
- Validate structural compliance of deliverables: every input row returned exactly once and unchanged, timestamps, exact decision and code spelling, correct separators, valid CSV, identifiers preserved as text.
- Track and report accuracy, review coverage, known limitations, and unresolved rows to support the summary report.
- Monitor progress to ensure on-time delivery.
Requirements
- At native proficiency level of Korean.
- 1+ years of experience in data annotation, content moderation, or QA; team lead or training experience preferred.
- Strong judgment on edge cases, with the ability to explain decisions clearly.
- Clear communication and the ability to give constructive feedback.
Nice to have
- Experience building evaluation sets, analyzing accuracy, or managing annotation quality.
- Understanding of AI-assisted annotation workflows and associated risk controls.
VPN and Location Verification: What You Need to Know
- 1.
- Application and onboarding: no VPN.
- Please do not use a VPN when you apply or go through onboarding.
- 2.
- Production: VPN required.
- Once production starts, you will need to use a VPN.
- Opera browser is recommended. (Opera is a free built-in VPN and needs no extra installation.) We will send you setup instructions before production begins.
- 3.
- Which VPNs are allowed.
- Standard consumer VPNs are fine.
- High-risk proxies are not permitted.
- 4.
- Periodic checks in Production.
- For administrative reasons, we may occasionally ask you to access AI Trainer platform without your VPN so we can check your unmasked IP.
W
M
T
Q
X
C
Discussion
No comments yet. Ask a question or share a tip about this role.