Is this job worth applying to?

Pay

Not listedAsk before you sit any test. The typical top rate across 237 priced coding listings is $90/hr.

Getting in

Some screening~30–60 min profile + AI interview. Professional experience in your field.

Steady work

Work is patchyLong waits between tasks are common.

Payout record

Pays on timeSchedule: weekly. Paid via Not specified on the AI training page.

Freshness

RecentPosted 9d ago. Still listed on Braintrust on Nov 6, 2026.

Where you live

Named countries onlyOpen in United States, Canada, Argentina and 22 more.

The job description

Bring your expertise to the problems today’s most advanced AI agents still struggle to solve.

We’re looking for experienced professionals to develop challenging tasks for an AI benchmark. You’ll draw on problems from your own field and turn them into clearly defined challenges that an AI agent must solve from scratch in a Linux terminal.

What you’ll do

Identify difficult, meaningful problems in your area of expertise.
Translate those problems into tasks that can be solved in a Linux terminal.
Design challenges that expose limitations in advanced AI agents. Each task is tested against three leading models, with three attempts per model, and must prove difficult enough that the models mostly fail.

Who we’re looking for

A completed master’s degree or higher. Candidates with a bachelor’s degree, at least 10 years of relevant professional experience and a publication may also be considered.
At least 10 years of professional experience in a technical domain.
Expertise in coding, machine learning, systems, cybersecurity or hardware.
At least one academic or professional publication.
Practical comfort working in a Linux terminal.
Currently resides in Argentina, Mexico, Puerto Rico, New Zealand, Canada, the United Kingdom, the United States, Australia, Peru, Colombia, Austria, Ireland, Spain, Luxembourg, Italy, France, Germany, Belgium, the Netherlands, Sweden, Finland, Singapore, Denmark, Norway or Switzerland. Candidates residing in New York, New Jersey or California are not eligible.

Project details

Task-based project expected to run for at least seven weeks.
Onboarding includes two courses and a graded assessment, taking approximately 90 minutes.
A live onboarding webinar is also required.

Compensation

Earn up to $1,350 per task, with opportunities for higher rates based on task quality and submission volume.
Tasks take six to seven hours on average, although initial tasks may take longer as you get familiar with the process.

How do you apply to Braintrust?

Apply on Braintrust

The Apply button opens this post on Braintrust's own site. You apply with them, not with Rubric. Budget about 30–60 min profile + AI interview.

Get through screening

What Braintrust asks for after you apply:

Complete the AI skills interview
Browse and accept AI training tasks in your dashboard

Start work and get paid

Pay schedule: weekly. Paid via Not specified on the AI training page. You're paid for the work they hand out, not a fixed salary.

Braintrust also needs

Professional experience in your field
Complete profile

Red flags

None on record for Braintrust. A real platform never asks you to pay for training, equipment or a "starter kit".

What is Braintrust like to work for?

Freelance talent network that now also runs AI training work, matching professionals to rating, red-teaming and code-review tasks after an AI skills interview.

Advertised pay	$20–200/hr
Getting in	Some screening
Application takes	~30–60 min profile + AI interview
How you get paid	Weekly, via Not specified on the AI training page
Payout record	Pays on time
Countries	Remote and open to freelancers in many countries with pay in USD; India eligibility for AI training tasks is not confirmed.

Braintrust lists $20–45/hr for data labeling, $25–60/hr for RLHF rating and up to $200/hr for expert code review; listings average around $50/hr.