Is this job worth applying to?

Pay

Above typicalTops out at $150/hr. The typical top rate across 237 priced coding listings is $90/hr.

Getting in

Hard to get in1–2 hours (one-time starter assessment). Fluent English.

Steady work

Comes and goesWorkload can drop to zero for weeks.

Payout record

Pays on timeSchedule: on request; arrives within a few days. Paid via PayPal.

Freshness

No post dateDataAnnotation doesn't publish post dates. First seen Oct 28, 2026; still listed Nov 6, 2026.

Where you live

Not statedThe listing names no country.

The job description

Overview

The newest models can vibe-code a whole feature in minutes. Someone has to check whether that code actually works, and that someone is you.

You'll run agentic coding sessions on real engineering tasks, analyze what the models produce, and red-team them until they fail in interesting ways. Every failure you document teaches the next generation of coding agents.

What you’ll actually do

Vibe-code with frontier models on real tasks: fix a bug, extend an API, ship a feature, and see how far the model gets on its own.
Analyze the AI's work against production standards: find the bugs, explain the failure, and rate the model's reasoning.
Red-team the models to expose unsafe code, faked test passes, and confidently wrong solutions before real users hit them.

Roles this fits

Common backgrounds: Software Engineer, Backend Engineer, Full-Stack Developer, DevOps Engineer.

What we look for

Professional or serious open-source experience shipping production code.
Comfort in at least one major stack; most tasks use Python, C++, Rust, Go, or JavaScript.
Clear written English: your explanations are the training signal.
No degree required. We care about what you can do, not where you learned it.

How it works

Apply

Qualify

Work & get paid

Compensation

Up to $150+/hr depending on task difficulty and specialization. Many contributors add $100k–$200k a year; some make it their full-time income.

About DataAnnotation

DataAnnotation is where 1M+ experts train the world’s leading AI models. Hundreds of millions paid to contributors to date, and the average contributor stays 5+ years. Flexible, remote, and always project-available.

Apply now

How do you apply to DataAnnotation?

Apply on DataAnnotation

The Apply button opens this post on DataAnnotation's own site. You apply with them, not with Rubric. Budget 1–2 hours (one-time starter assessment).

Get through screening

What DataAnnotation asks for after you apply:

Take the starter assessment; you only get one attempt
Wait for an email with the result (many never hear back)
Verify your identity with Persona
Pick projects from your dashboard

Start work and get paid

Pay schedule: on request; arrives within a few days. Paid via PayPal. You're paid for the work they hand out, not a fixed salary.

DataAnnotation also needs

Fluent English
PayPal account
Government ID for verification

Red flags

Red flagAccounts deactivated without explanation, sometimes with unpaid balances reported
Red flagNo reply after the unpaid starter assessment
Red flagMay 2025 class action over contractor status and unpaid assessments (allegations)

What is DataAnnotation like to work for?

Surge AI's worker-facing platform: you pass one starter assessment, then pick paid writing, coding and rating tasks from a dashboard whenever you like.

Advertised pay	$20–150/hr
Getting in	Hard to get in
Application takes	1–2 hours (one-time starter assessment)
How you get paid	On request; arrives within a few days, via PayPal
Payout record	Pays on time
Countries	Historically limited to the US, UK, Canada, Australia, New Zealand and Ireland, with some workers reporting access from other countries. India has not been on the published list.

Official starting rates are $25–50/hr general, $40–150/hr coding and $40–125/hr STEM/professional; workers report general tasks often settle around $20–30/hr.