Conversation Quality Analyst
$40–120/hr
Remote writing contract with Alignerr, $40–120/hr. Posted Oct 27.
$40–120/hr
Apply on AlignerrIs this job worth applying to?
- Pay
- Above typicalTops out at $120/hr. The typical top rate across 80 priced writing listings is $68/hr.
- Getting in
- Hard to get in~1–2 hours of assessments. Valid government photo ID.
- Steady work
- Work is patchyFeast-or-famine project volume.
- Payout record
- Some delaysSchedule: weekly, by Friday for the prior Monday–Sunday. Paid via Stripe or PayPal (depends on country).
- Freshness
- RecentPosted 10d ago. Still listed on Alignerr on Nov 6, 2026.
- Where you live
- Not statedThe listing names no country.
The job description
About the Role
What if your instinct for natural conversation could directly influence how AI communicates with millions of people? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they sound human, helpful, and genuinely useful.
This is a fully remote, flexible contract role open to anyone with strong reading comprehension and a sharp ear for how people actually talk. No AI, linguistics, or technical background required — just a reliable internet connection and a genuine feel for natural communication.
What You'll Do
- Read and evaluate AI-generated conversations across a wide range of topics and contexts
- Rate responses for naturalness, helpfulness, tone, and conversational flow
- Identify awkward phrasing, off-topic replies, logical inconsistencies, or unnatural transitions
- Compare multiple conversation paths and rank them by overall quality
- Submit structured, detailed evaluations using provided rubrics and rating tools
- Work independently and asynchronously on your own schedule
Who You Are
- Strong reading comprehension and a natural instinct for how conversations should flow
- Ability to assess whether a response feels human, relevant, and appropriate in context
- Detail-oriented with a consistent and systematic approach to evaluation
- Comfortable working through large volumes of dialogue without losing focus
- Self-motivated and reliable when working independently
- No prior AI, linguistics, or quality assurance experience required
Nice to Have
- Background in writing, editing, communications, or customer-facing roles
- Experience with content review, quality assurance, or critical analysis
- Familiarity with AI tools or chatbots as an end user
Why Join Us
- Work on cutting-edge AI projects alongside leading research labs
- Fully remote and flexible — work when and where it suits you
- Freelance autonomy with the structure of meaningful, task-based work
- Contribute directly to AI development that shapes how technology speaks with the world
- Potential for ongoing work and contract extension as new projects launch
How do you apply to Alignerr?
Apply on Alignerr
The Apply button opens this post on Alignerr's own site. You apply with them, not with Rubric. Budget about 1–2 hours of assessments.
Get through screening
What Alignerr asks for after you apply:
- Take the TestGorilla skills assessment (usually one attempt per role)
- Verify your identity with Persona
- Join the Alignerr Slack community
- Set up payouts once you are assigned to a project
Start work and get paid
Pay schedule: weekly, by Friday for the prior Monday–Sunday. Paid via Stripe or PayPal (depends on country). You're paid for the work they hand out, not a fixed salary.
Alignerr also needs
- Valid government photo ID
- Degree or professional experience for expert roles
- Webcam for proctored assessments on some roles
Red flags
- Red flagLong gaps with no project after passing
- Red flagWorker reports of delayed or withheld payments on Glassdoor
What is Alignerr like to work for?
Labelbox's contractor network, which hires generalists and domain experts to label data and write and grade AI training tasks.
| Advertised pay | $15–150/hr |
|---|---|
| Getting in | Hard to get in |
| Application takes | ~1–2 hours of assessments |
| How you get paid | Weekly, by Friday for the prior Monday–Sunday, via Stripe or PayPal (depends on country) |
| Payout record | Some delays |
| Countries | Accepts most countries but blocks signups from about two dozen; posts India-specific roles such as Hindi, Telugu and Indian-English language and cultural review work. |
Generalist and bilingual work is around $15–20/hr, coding QA $30–40/hr, and senior software, advanced math, medical and law roles $70–150/hr; some projects pay per approved task.
