AIWorkJobs
Micro1 logomicro1Platform listing

AI Agent Evaluator

Test two AI agents on your phone by asking them to handle everyday errands, then review what happened from a user’s perspective. Each run takes about 1.5 hours, including recording evidence and scoring results. You’ll…

Remote · United States onlyContract
Work arrangement
Remote
Eligibility
United States only
Engagement
Contract
Compensation
$25–$45/hr
Specialty
AI Training

About the role

Test two AI agents on your phone by asking them to handle everyday errands, then review what happened from a user’s perspective. Each run takes about 1.5 hours, including recording evidence and scoring results. You’ll need an active personal account with a popular AI service, such as ChatGPT, and a smartphone with screen recording. After presentation to the hiring manager, onboarding typically takes 24–48 hours.

What you would do

  • Test agents on scenarios such as bill payments, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms.
  • Approve or stop an agent at key points in each task.
  • Screen record every attempt.
  • Rate each run for completion, quality, control issues, satisfaction, and time.
  • Write clear feedback about the agent experience.

Requirements

  • Live in the United States and hold a bachelor’s degree.
  • Have 2–3 years of work experience.
  • Use AI in everyday life and have an active personal account with a popular AI service. Eligible account tiers include Free, Go, Plus, or Pro.
  • Have a smartphone that can record its screen.
  • Follow instructions with care and document each step.
  • Communicate clearly in writing.
  • No coding experience or AI background is needed.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience in engineering, business management, or office and operations work.
  • Expertise in a specific domain; generalists are also welcome.

Who should apply

A U.S.-based bachelor’s degree holder with 2–3 years of experience who uses AI in daily life and can carefully record, assess, and explain how agents handle real-world errands. No coding or AI background is required.

How applying works on Micro1

Apply through the opportunities portal, complete an AI interview, verify your identity, and join the certified talent pool.

  1. Apply through the opportunities portal or accept a platform invitation.
  2. Complete the AI interview covering communication, reasoning, and role skills.
  3. Verify your government ID and sign the platform contract.
  4. Join the certified talent pool and wait for project matching.

Typical timeline: Micro1 does not publish a fixed interview length. Certification is typically reviewed within 30 days.

Paid steps: Not stated by the source

Certification does not guarantee a project placement.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Micro1 process and its official source on the Micro1 page.

Skills mentioned by the source

  • ChatGPT
  • Muse
  • AI agents
  • Attention to Detail
  • Following Instructions
  • Screen Recording
  • Dots
  • Mobile

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: ai-agent-evaluator-b884c4. Source: Micro1. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

micro1

AI Agent Tester

Test two AI agents on your smartphone by asking them to handle everyday errands, then record and assess each attempt. Runs take about 1.5 hours, including evidence and scoring. You need an active personal account for a popular AI tool, such as a Free, Go, Plus, or Pro account, and a phone that can record its screen. After presentation to the hiring manager, onboarding usually takes 24 to 48 hours.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$25–$45/hr
  • ChatGPT
  • Muse
  • AI agents
Quality Assurance & TestingView job

Handshake AI

AI Evaluation Specialist

Contribute to short-term AI research projects with leading AI labs by applying your academic knowledge to improve large language models in specific fields and topics. Work remotely with no minimum hour commitment. Handshake provides brief training, and you must pass one assessment before starting. Successful project work may qualify you for future projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$17/hr
  • large language models
  • ai evaluation
  • ai training
Machine Learning & AIView job

Turing · via Braintrust

AI Assistant Evaluator - AI Research Study

Take part in a 16-week study that examines AI assistants through the lens of everyday users. You’ll review English prompts and responses for Gemini, Instinct, or Muse, then assess response quality and share feedback under the study guidelines. The schedule calls for 20 hours per week, with a 40-hour option, plus four hours of overlap with Pacific Time working hours.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$15/hr
  • gemini
  • instinct
  • muse
AI evaluationView job

Turing

AI Assistant Raters - US Based

Evaluate AI assistant responses based on user experience and quality.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • ai evaluation
  • response evaluation
  • prompt evaluation
AI evaluationView job