AI Evaluation Rubric Reviewer
Review AI-drafted shopping and delivery tasks, their grading rubrics and model attempts, fixing unfair criteria for an AI agent evaluation project. Remote, $40-$75/hr.
Free. See how your CV fits this role before you apply.
Pay
$60 – $85/h
Who can apply
No country restriction listed by the platform · checked November 17, 2026
Checked
We checked this role on the platform 11 hours ago and re-check every day.
Flash, hiring through Mercor, is testing AI agents on realistic shopping and delivery tasks. As a Project Auditor you sit above the reviewers: you audit their completed tasks and decide whether the rubric failures they confirmed are fair.
One weekly email with new roles like this one, filtered by field and pay. Free, no spam.
Review AI-drafted shopping and delivery tasks, their grading rubrics and model attempts, fixing unfair criteria for an AI agent evaluation project. Remote, $40-$75/hr.
Mercor is running a paid one-hour research interview with US insurance agency service and account management leads about AMS workflows. Remote, US only, $380 flat.
Mercor is running a paid one-hour research interview with US insurance agency operations and finance leaders about agency management software. Remote, US only, $380 flat.