Korean Voice AI Evaluator – Native Speakers Wanted
$12–40/hr
Remote audio contract with Alignerr, $12–40/hr, open to people in United States. Posted Oct 22.
$12–40/hr
Apply on AlignerrIs this job worth applying to?
- Pay
- About typicalTops out at $40/hr. The typical top rate across 238 priced audio listings is $40/hr.
- Getting in
- Hard to get in~1–2 hours of assessments. Valid government photo ID.
- Steady work
- Work is patchyFeast-or-famine project volume.
- Payout record
- Some delaysSchedule: weekly, by Friday for the prior Monday–Sunday. Paid via Stripe or PayPal (depends on country).
- Freshness
- RecentPosted 2w ago. Still listed on Alignerr on Nov 6, 2026.
- Where you live
- Named countries onlyOpen in United States.
The job description
About the Role
What if your voice could help teach AI how to handle a real phone call to a hospital or clinic? We're looking for native Korean speakers based in the United States to hold natural spoken conversations with an AI healthcare receptionist, then evaluate how well it listens, responds, and takes action.
With one of the largest Korean-speaking diaspora communities in the world, the US is home to a wealth of native-fluency talent perfectly suited to this role. You'll role-play as a patient using fictional personas we provide, record short conversations, and grade the AI's performance — all from home, on your own schedule.
What You'll Do
- Hold 4 to 5 minute spoken conversations in Korean with an AI front desk assistant, playing a fictional patient
- Say natural trigger phrases to test whether the AI makes the correct function calls — for example, checking a patient record, booking an appointment, or checking insurance
- Review transcripts and classify how accurately the AI understood you and responded
- Flag issues such as mispronunciations, cutoffs, interruptions, delays, and incorrect function calls, including timestamps
- Test how the AI handles background noise, short replies ("네," "아니요," "괜찮아요"), long numbers, emotional moments, and sensitive or unsafe requests
- Follow detailed labeling guidelines consistently and submit high-quality work
Who You Are
- Native or near-native Korean speaker with a clear, natural speaking voice
- Detail-oriented, with the patience to review recordings and transcripts closely
- Comfortable role-playing a patient and sounding authentic
- Able to follow multi-step instructions and apply them consistently
- Reliable and self-directed when working independently
- Access to a quiet space, a good microphone, a stable internet connection, and a second device for playing background noise
- Comfortable using web-based tools
Nice to Have
- Experience in voice AI evaluation, data annotation, or QA testing
- Background in healthcare administration, customer service, or call center work
- Strong sense of Korean speech levels and politeness (존댓말) in service conversations, and of how Korean numbers are read aloud (native vs. Sino-Korean)
- Linguistics or language-focused studies
- Familiarity with medical terminology in Korean
Why Join Us
- Work on cutting-edge AI projects alongside leading research labs
- Fully remote and flexible — work when and where it suits you
- Task-based work with real autonomy
- Directly help make voice AI more accurate, natural, and safe in healthcare settings
- Potential for ongoing work as new projects launch
Note: New contributors complete a short unpaid qualification assessment. Contributors who pass are added to paid production work.
How do you apply to Alignerr?
Apply on Alignerr
The Apply button opens this post on Alignerr's own site. You apply with them, not with Rubric. Budget about 1–2 hours of assessments.
Get through screening
What Alignerr asks for after you apply:
- Take the TestGorilla skills assessment (usually one attempt per role)
- Verify your identity with Persona
- Join the Alignerr Slack community
- Set up payouts once you are assigned to a project
Start work and get paid
Pay schedule: weekly, by Friday for the prior Monday–Sunday. Paid via Stripe or PayPal (depends on country). You're paid for the work they hand out, not a fixed salary.
Alignerr also needs
- Valid government photo ID
- Degree or professional experience for expert roles
- Webcam for proctored assessments on some roles
Red flags
- Red flagLong gaps with no project after passing
- Red flagWorker reports of delayed or withheld payments on Glassdoor
What is Alignerr like to work for?
Labelbox's contractor network, which hires generalists and domain experts to label data and write and grade AI training tasks.
| Advertised pay | $15–150/hr |
|---|---|
| Getting in | Hard to get in |
| Application takes | ~1–2 hours of assessments |
| How you get paid | Weekly, by Friday for the prior Monday–Sunday, via Stripe or PayPal (depends on country) |
| Payout record | Some delays |
| Countries | Accepts most countries but blocks signups from about two dozen; posts India-specific roles such as Hindi, Telugu and Indian-English language and cultural review work. |
Generalist and bilingual work is around $15–20/hr, coding QA $30–40/hr, and senior software, advanced math, medical and law roles $70–150/hr; some projects pay per approved task.
