AI Evaluation Rubric Auditor
Audit reviewers' work on AI agent shopping and delivery tasks, checking that rubric failures are fair and giving feedback to reviewers. Remote, $60-$85/hr.
Free. See how your CV fits this role before you apply.
Pay
$40 – $75/h
Who can apply
No country restriction listed by the platform · checked November 17, 2026
Checked
We checked this role on the platform 13 hours ago and re-check every day.
Flash, hiring through Mercor, is testing AI agents on realistic shopping and delivery tasks. As a rubric reviewer you check whether each recorded failure is actually fair to the model, and repair the grading where it is not.
One weekly email with new roles like this one, filtered by field and pay. Free, no spam.
Audit reviewers' work on AI agent shopping and delivery tasks, checking that rubric failures are fair and giving feedback to reviewers. Remote, $60-$85/hr.
Mercor is running a paid one-hour research interview with US insurance agency service and account management leads about AMS workflows. Remote, US only, $380 flat.
Mercor is running a paid one-hour research interview with US insurance agency operations and finance leaders about agency management software. Remote, US only, $380 flat.