Is this job worth applying to?

Pay

About typicalTops out at $90/hr. The typical top rate across 237 priced coding listings is $90/hr.

Getting in

Hard to get in~1–2 hours of assessments. Valid government photo ID.

Steady work

Work is patchyFeast-or-famine project volume.

Payout record

Some delaysSchedule: weekly, by Friday for the prior Monday–Sunday. Paid via Stripe or PayPal (depends on country).

Freshness

RecentPosted 11d ago. Still listed on Alignerr on Nov 6, 2026.

Where you live

Named countries onlyOpen in United States.

The job description

About the Role

What if your Python expertise could directly influence how AI writes code for millions of developers around the world? We're looking for experienced Python Engineers to evaluate AI-generated code, solve complex algorithmic challenges, and help ensure the next generation of AI coding tools meets the standards of real production engineering.

This is a fully remote, flexible contract role built for senior Python developers who want meaningful, high-impact work alongside the world's leading AI research labs — on their own schedule.

What You'll Do

Review and evaluate AI-generated Python code for correctness, efficiency, and adherence to professional best practices
Solve complex algorithmic problems and develop high-quality Python solutions that set the benchmark for AI outputs
Write clear, human-readable explanations of code logic and problem-solving strategies
Identify edge cases, bugs, and ambiguities in AI-generated responses
Provide structured, detailed feedback that directly improves how AI models understand and write Python
Work independently and asynchronously — fully on your own schedule

Who You Are

Deep, hands-on expertise in Python — you've written production-level code and it shows
3–5+ years of professional Python development experience
Strong command of modern Python frameworks including Django, Flask, or FastAPI
Comfortable with advanced language features, design patterns, and performance considerations
Excellent written communicator — you can explain complex technical concepts clearly and concisely
Bachelor's degree or higher in Computer Science or a related technical field
Self-motivated and consistent when working independently

Nice to Have

Prior experience with data annotation, RLHF, or AI evaluation workflows
Background in algorithm design, competitive programming, or technical problem-solving
Familiarity with code review processes or software quality evaluation
Experience working across multiple domains of Python — data science, backend, automation, or systems

Why Join Us

Work on cutting-edge AI projects alongside the world's leading research labs
Fully remote and flexible — work when and where it suits you
Freelance autonomy with the structure of meaningful, task-based work
Make a direct, tangible impact on how AI understands and generates code at scale
Potential for ongoing work and contract extension as new projects launch

How do you apply to Alignerr?

Apply on Alignerr

The Apply button opens this post on Alignerr's own site. You apply with them, not with Rubric. Budget about 1–2 hours of assessments.

Get through screening

What Alignerr asks for after you apply:

Take the TestGorilla skills assessment (usually one attempt per role)
Verify your identity with Persona
Join the Alignerr Slack community
Set up payouts once you are assigned to a project

Start work and get paid

Pay schedule: weekly, by Friday for the prior Monday–Sunday. Paid via Stripe or PayPal (depends on country). You're paid for the work they hand out, not a fixed salary.

Alignerr also needs

Valid government photo ID
Degree or professional experience for expert roles
Webcam for proctored assessments on some roles

Red flags

Red flagLong gaps with no project after passing
Red flagWorker reports of delayed or withheld payments on Glassdoor

What is Alignerr like to work for?

Labelbox's contractor network, which hires generalists and domain experts to label data and write and grade AI training tasks.

Advertised pay	$15–150/hr
Getting in	Hard to get in
Application takes	~1–2 hours of assessments
How you get paid	Weekly, by Friday for the prior Monday–Sunday, via Stripe or PayPal (depends on country)
Payout record	Some delays
Countries	Accepts most countries but blocks signups from about two dozen; posts India-specific roles such as Hindi, Telugu and Indian-English language and cultural review work.

Generalist and bilingual work is around $15–20/hr, coding QA $30–40/hr, and senior software, advanced math, medical and law roles $70–150/hr; some projects pay per approved task.