About Rubric
Rubric is a free, independent directory of AI training, RLHF and data annotation jobs. We collect open listings from the platforms we track every day, grade 18 platforms on how hard they are to get into, how steady the work is and how reliably they pay, and write plain answers to the questions people ask before signing up. No accounts, no fees, and no platform can buy a better grade.
Who is Rubric for?
Anyone weighing up AI training work: people looking for their first project, experts (engineers, clinicians, lawyers, PhDs) comparing expert marketplaces, and people in countries where it's hard to tell which platforms will accept them. The information used to be scattered across Reddit threads, Discord servers and review sites with an incentive to make every platform sound great.
How are jobs collected?
- Daily. A script reads each platform's public job pages and public job-board feeds once a day. It identifies itself as
RubricJobsBot, waits between requests and reads only what anyone can see without logging in. - Filtered. On boards that mix staff and contractor roles, we keep AI training roles (tutor, trainer, rater, annotator, evaluator, domain expert and similar) and drop recruiting, sales and other staff jobs.
- De-duplicated. When a platform posts the same role for many cities with identical pay, we show it once.
- Removed when stale. Listings that drop off the source are taken off Rubric.
- Linked to the source. Every listing links to the platform's own page. Pay, countries and requirements are what the platform states; we don't fill in missing values.
Today we're tracking 1,815 open listings (posts more than a year old are listed but not counted). The aggregated numbers are in the pay report.
How do we grade platforms?
Every platform gets three 1–5 grades, shown as chips on its grade sheet:
| Grade | What it measures | 1 means | 5 means |
|---|---|---|---|
| Entry difficulty | How hard it is to be accepted: degree or license requirements, test difficulty, country limits, waiting time | Almost anyone can get an account | Credentialed experts only, multi-stage screening |
| Work reliability | Whether accepted workers actually get steady tasks or hours | Long empty queues are the norm | Steady, predictable work |
| Payout reliability | Whether pay arrives on time and in full | Frequent missing or held pay | On schedule, rarely disputed |
Grades come from the platform's own terms and help pages, its job listings, and patterns in worker reports on Reddit, Trustpilot, Glassdoor and similar sites. One angry review doesn't move a grade; repeated, specific reports do. Each grade sheet lists its sources and the date it was last checked. Red flags are reserved for serious, repeated problems such as withheld pay or legal action, and we say plainly when something is an allegation rather than a finding.
Rankings on the best-platform lists are calculated from these grades plus advertised pay, using the rule stated at the top of each list.
How often is the data updated?
| Data | How often |
|---|---|
| Open job listings | Every day |
| Pay report | Rebuilt with the job list every day |
| Platform grades, pay ranges, payout details | At least monthly, and when a platform changes its terms |
| Guides | Reviewed at least every three months; the "Updated" date is the last real check |
Platform data was last checked 2026-11-06.
How does Rubric make money?
Some Apply links may be referral links: if you join a platform through one, the platform may pay us a bonus. It costs you nothing and never changes a grade, a ranking or what we write.
How do I contact Rubric?
Email hello@rubric.world for corrections, a platform we're missing, or a job that's gone. We will never contact you first about a job.
Other questions people ask
Is Rubric affiliated with Mercor, Outlier or any other platform?
No. Rubric is independent. No platform reviews our grades before they are published, and none can pay to change a grade or ranking. Some Apply links may be referral links.
Does Rubric charge workers anything?
No. Rubric is free, with no account and no sign-up. We never ask for money, ID documents or personal details, and nobody from Rubric will message you on WhatsApp or Telegram.
Does Rubric hire for these jobs?
No. We list jobs and link to the platform's own page. You apply, interview and get paid on the platform.
I found a mistake. How do I report it?
Email us with the page and what's wrong, ideally with a link to a source. We fix factual errors and note significant corrections on the page.