Emergency Medicine Physician – AI Evaluation
$135/hr
Remote part time medical contract with Braintrust, $135/hr, open to people in United States. Posted Oct 30.
$135/hr
Apply on BraintrustIs this job worth applying to?
- Pay
- Above typicalTops out at $135/hr. The typical top rate across 138 priced medical listings is $100/hr.
- Getting in
- Some screening~30–60 min profile + AI interview. Professional experience in your field.
- Steady work
- Work is patchyLong waits between tasks are common.
- Payout record
- Pays on timeSchedule: weekly. Paid via Not specified on the AI training page.
- Freshness
- FreshPosted 7d ago. Still listed on Braintrust on Nov 6, 2026.
- Where you live
- Named countries onlyOpen in United States.
The job description
Bring your emergency medicine physician expertise to the development and evaluation of advanced AI systems. You will create realistic clinical cases, evaluate model responses and help establish clinically defensible standards within your specialty.
What You Will Do
Create challenging clinical tasks, longitudinal-chart scenarios, reference answers and evaluation rubrics focused on emergency clinical decision-making, patient safety and emergency-care or EMS handoffs.
Synthesize fragmented records, identify contradictions and missing actions, and assess clinical reasoning, documentation quality and patient safety.
Apply structured rubrics, review specialist feedback and refine cases through calibration cycles.
Review and calibrate contributors’ work, resolve ambiguous clinical or rubric issues and help maintain consistent quality standards.
What You Bring
At least 8 years of relevant professional experience, with current practice or recent practice within the last three years.
An active physician license, board certification or recognized credential appropriate to emergency medicine.
A relevant healthcare degree or equivalent practical experience.
Strong clinical reasoning, chart-review, documentation and written communication skills, with attention to clinically defensible conclusions and patient safety.
Ability to follow standardized rubrics, incorporate critique and work through fast-paced review and calibration cycles.
Nice to Have
Familiarity with US clinical guidelines, payer policies, regulatory requirements and healthcare workflows.
Experience with AI evaluation, clinical content or assessment development, expert review or quality improvement.
Engagement
Remote contractor project for US-based professionals, expected to last 12 weeks. Target start: November 2, 2026.
Part-time (20 hours per week) or full-time (40 hours per week), with four hours of overlap with Pacific working hours.
Selection includes an application review and assessment.
Compensation
USD 135 per hour.
How do you apply to Braintrust?
Apply on Braintrust
The Apply button opens this post on Braintrust's own site. You apply with them, not with Rubric. Budget about 30–60 min profile + AI interview.
Get through screening
What Braintrust asks for after you apply:
- Complete the AI skills interview
- Browse and accept AI training tasks in your dashboard
Start work and get paid
Pay schedule: weekly. Paid via Not specified on the AI training page. You're paid for the work they hand out, not a fixed salary.
Braintrust also needs
- Professional experience in your field
- Complete profile
Red flags
None on record for Braintrust. A real platform never asks you to pay for training, equipment or a "starter kit".
What is Braintrust like to work for?
Freelance talent network that now also runs AI training work, matching professionals to rating, red-teaming and code-review tasks after an AI skills interview.
| Advertised pay | $20–200/hr |
|---|---|
| Getting in | Some screening |
| Application takes | ~30–60 min profile + AI interview |
| How you get paid | Weekly, via Not specified on the AI training page |
| Payout record | Pays on time |
| Countries | Remote and open to freelancers in many countries with pay in USD; India eligibility for AI training tasks is not confirmed. |
Braintrust lists $20–45/hr for data labeling, $25–60/hr for RLHF rating and up to $200/hr for expert code review; listings average around $50/hr.