Alignerr

Search Quality Evaluator

  • Kind of work: Writing
  • Location: Open worldwide
  • Experience: Entry level
  • Hours: Flexible
  • Languages: English

$40–120/hr

Remote writing contract with Alignerr, $40–120/hr, open worldwide. Posted Oct 20.

$40–120/hr

Apply on Alignerr

Is this job worth applying to?

Pay
Above typicalTops out at $120/hr. The typical top rate across 80 priced writing listings is $68/hr.
Getting in
Hard to get in~1–2 hours of assessments. Valid government photo ID.
Steady work
Work is patchyFeast-or-famine project volume.
Payout record
Some delaysSchedule: weekly, by Friday for the prior Monday–Sunday. Paid via Stripe or PayPal (depends on country).
Freshness
RecentPosted 2w ago. Still listed on Alignerr on Nov 6, 2026.
Where you live
Open worldwideOpen worldwide.

The job description

About the Role

What if your everyday curiosity and sharp judgment could directly influence how AI finds and presents information to millions of people? We're looking for Search Quality Evaluators to assess search engine results, AI-generated answers, and content recommendations — helping ensure that the AI systems people rely on every day are accurate, relevant, and genuinely useful.

This is a fully remote, flexible contract role open to anyone with strong critical thinking and good written communication skills. No technical or AI background required — just a reliable internet connection, a methodical mindset, and a commitment to quality.

What You'll Do

  • Evaluate search engine results for relevance, accuracy, and overall usefulness to the user
  • Rate AI-generated answers and content recommendations using structured evaluation rubrics
  • Compare multiple search results and rank them by quality and appropriateness
  • Provide clear, concise written explanations that justify your ratings and rankings
  • Work through task-based assignments independently at your own pace and schedule
  • Cover a wide range of topics — from everyday queries to niche and complex subjects

Who You Are

  • Comfortable using search engines and navigating the web with confidence
  • Able to assess content relevance and quality objectively and consistently
  • Naturally detail-oriented with a systematic approach to evaluation tasks
  • Strong written communication skills in English
  • Self-motivated and reliable when working independently
  • No technical, AI, or search industry experience required

Nice to Have

  • Background in research, journalism, education, or content review
  • Experience with quality assurance, data annotation, or information analysis
  • Broad general knowledge across a variety of topics and subject areas
  • Familiarity with AI tools or search platforms as an everyday user

Why Join Us

  • Work on cutting-edge AI projects alongside leading research labs
  • Fully remote and flexible — work when and where it suits you
  • Freelance autonomy with the structure of meaningful, task-based work
  • Contribute directly to AI development that shapes how the world finds information
  • Potential for ongoing work and contract extension as new projects launch

How do you apply to Alignerr?

  1. Apply on Alignerr

    The Apply button opens this post on Alignerr's own site. You apply with them, not with Rubric. Budget about 1–2 hours of assessments.

  2. Get through screening

    What Alignerr asks for after you apply:

    • Take the TestGorilla skills assessment (usually one attempt per role)
    • Verify your identity with Persona
    • Join the Alignerr Slack community
    • Set up payouts once you are assigned to a project
  3. Start work and get paid

    Pay schedule: weekly, by Friday for the prior Monday–Sunday. Paid via Stripe or PayPal (depends on country). You're paid for the work they hand out, not a fixed salary.

Alignerr also needs

  • Valid government photo ID
  • Degree or professional experience for expert roles
  • Webcam for proctored assessments on some roles

Red flags

  • Red flagLong gaps with no project after passing
  • Red flagWorker reports of delayed or withheld payments on Glassdoor

What is Alignerr like to work for?

Labelbox's contractor network, which hires generalists and domain experts to label data and write and grade AI training tasks.

Advertised pay$15–150/hr
Getting inHard to get in
Application takes~1–2 hours of assessments
How you get paidWeekly, by Friday for the prior Monday–Sunday, via Stripe or PayPal (depends on country)
Payout recordSome delays
CountriesAccepts most countries but blocks signups from about two dozen; posts India-specific roles such as Hindi, Telugu and Indian-English language and cultural review work.

Generalist and bilingual work is around $15–20/hr, coding QA $30–40/hr, and senior software, advanced math, medical and law roles $70–150/hr; some projects pay per approved task.

$40–120/hrAdvertised payApply on Alignerr