SWE-Bench AI Task Auditor – Freelance AI Trainer Project
$60/hr
Remote coding contract with Invisible, $60/hr, open worldwide. Posted Sep 4.
$60/hr
Apply on InvisibleIs this job worth applying to?
- Pay
- Below typicalTops out at $60/hr. The typical top rate across 237 priced coding listings is $90/hr.
- Getting in
- Some screeningVaries; several days to weeks. Expertise or language fluency matching a listed project.
- Steady work
- Work is patchyHours can be very low.
- Payout record
- Pays on timeSchedule: varies by project. Payment method not published.
- Freshness
- Older postPosted 2mo ago. Still listed on Invisible on Nov 6, 2026.
- Where you live
- Open worldwideOpen worldwide.
The job description
Project Overview We are sourcing experienced technical specialists in Software Engineering (SWE-Bench) to audit tasks used to train and evaluate AI systems. The objective of this project is to ensure that AI training workflows and tasks are technically rigorous, practical, and highly accurate within your specific area of expertise.
Project Deliverables & Scope
Task Evaluation: Assess whether software engineering tasks are technically accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria.
Technical Auditing & Feedback: Provide clear, actionable feedback on any identified codebase integration issues, test failures, or logic errors within the tasks.
Required Expertise
Demonstrable professional experience and deep technical knowledge in software engineering (including complex codebase navigation, real-world application development, and SWE-Bench standards). (Note: Candidates will be considered for one specialty based on their experience; expertise across other domains is not required).
Strong analytical and problem-solving skills to rigorously test, troubleshoot, and evaluate complex technical scenarios.
We offer a pay rate of $60 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.
Workplace type: Remote
How do you apply to Invisible?
Apply on Invisible
The Apply button opens this post on Invisible's own site. You apply with them, not with Rubric. Timing: varies; several days to weeks.
Get through screening
What Invisible asks for after you apply:
- Browse open projects on Meridial
- Join the network and complete your profile, including country
- Take the skills assessment or interview for the project
- Wait to be matched and onboarded to a project team
Start work and get paid
Pay schedule: varies by project. Ask how they pay you, too. You're paid for the work they hand out, not a fixed salary.
Invisible also needs
- Expertise or language fluency matching a listed project
- Reliable internet
Red flags
- Red flagClients or projects disappearing for months with no update
- Red flagSudden project cancellations
What is Invisible like to work for?
AI training and operations company that hires freelance AI trainers through its Meridial expert network, mostly onto team-based projects.
| Advertised pay | $6–65/hr |
|---|---|
| Getting in | Some screening |
| Application takes | Varies; several days to weeks |
| How you get paid | Varies by project |
| Payout record | Pays on time |
| Countries | Each listing names the countries it accepts, some covering about 145 countries. Invisible has posted India-only roles (coding, Telugu, Tamil, Marathi, Hindi), with pay adjusted by location. |
Listings show $6–65/hr and the rate depends on your country; many entry projects pay around $15–25/hr.