AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Handshake AI

Obstetrician-Gynecologist

Practicing OB/GYN physicians can contribute clinical expertise to year-round AI research through flexible, project-based work alongside their current role. You’ll create expert-level clinical tasks and assess AI responses across areas such as prenatal care, labor and delivery, gynecologic conditions, and treatment planning. Projects open at intervals, and you can work remotely at your own pace without set hours or a minimum commitment.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$200/hr
  • obstetrics
  • gynecology
  • prenatal care
Healthcare & MedicalView job

SME Careers

Customer Service (Call Center) Expert

Use your call center expertise to shape natural conversations for speech-to-speech AI agents. You will act out customer support scenarios, assess and rank model responses, and check outputs for inaccuracies or bias. The role requires at least two years in customer service, one year in AI training, and C1+ spoken English; the English requirement is limited to US candidates.

Location and eligibility
Remote · Canada, United States
Engagement type
Contract
Compensation
Up to $30/hr
  • ai training
  • call center
  • customer service
Customer SupportView job

micro1

NDT Subject Matter Expert – Laser Shearography (Level II / Level III)

Apply Laser Shearography expertise to an aerospace inspection project that helps train AI systems. You will assess shearography data and composite defects, interpret technical inspection materials, and explain your findings in writing. Prior AI experience is not required. All assessments must rely on manual review, without AI tools.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$40–$100/hr
  • Laser Shearography
  • Non-Destructive Testing (NDT)
  • ASNT Level II / III
Quality Control & InspectionView job

Turing

Privacy & Data Protection Law Expert

Evaluate AI responses for compliance with U.S. privacy laws and regulations.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • ccpa
  • cpra
  • u.s. privacy law
LegalView job

AfterQuery

Biology Expert

Create and assess biology evaluation material used to test how AI models reason about life sciences. You’ll develop scenarios that span experimental design to interpretation, write evidence-based reference answers, and judge model responses for biological accuracy and uncertainty. Work remotely on an async schedule as an independent contractor, with a minimum commitment of 10 hours per week and no fixed daily hours.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$90/hr
  • biology
  • genetics
  • ecology
Science & ResearchView job

Mercor

Biologist Talent Network

Apply to Mercor’s Biologist Expert Network for consideration in future contract projects with AI labs and companies. After you complete your profile and pass an AI interview, Mercor reviews your credentials and matches approved experts to projects as needs arise. Work may cover AI training and evaluation, scenario-based task creation, or research feedback. Typical project commitments range from 15 to 30 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$80/hr
  • biology
  • molecular biology
  • cellular biology
Machine Learning & AIView job

Handshake AI

Software Engineer

Help assess and improve coding agents by giving them real engineering tickets, running their work, and tracing mistakes through a codebase you know. The contract offers 40 hours each week at $6,000, paid each week, with hours you set. It renews each week when your work meets quality standards. Selection involves a proctored coding assessment and a paid trial task.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$150/hr
  • software engineering
  • code review
  • coding agents
Software EngineeringView job

SME Careers

Marathi Team Lead with Mathematical Background

As a remote contract Marathi Quality Assurance Lead, you will assess Marathi AI training content and contributor work against project rubrics. You will guide trainers and reviewers on language standards, investigate recurring quality problems, and maintain materials such as Marathi style guides and quality trackers. The selection process includes an AI interview, a domain-specific task, and a recruiter interview.

Location and eligibility
Remote · India, Mauritius, Pakistan
Engagement type
Contract
Compensation
Up to $25/hr
  • marathi
  • english
  • mathematics
Language & LinguisticsView job

micro1

Digital Artist

A US-based contract project for Digital Artists who can compare original artwork or photographs with AI-generated images and document visual flaws. You’ll contribute image examples, assess details such as anatomy, lighting, and texture, and write clear feedback that helps train AI image models. Prior AI experience is not required.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$21–$45/hr
  • image evaluation
  • Comparative ranking
  • attention to visual detail
Design & CreativeView job

Turing

AI Quality Analyst (Personalization) - Spanish

Evaluate personalized Gemini responses in Spanish for relevance and accuracy.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • spanish
  • gemini
  • prompt engineering
Language & LinguisticsView job

AfterQuery

High School Teacher Expert

Create assessment and learning materials grounded in high school coursework, including rubrics, sample responses, research briefs, and instructional activities. You’ll also assess AI-generated work for sound reasoning, clear organization, and effective teaching choices. The role supports the development of AI educational tools, follows a remote, asynchronous schedule, and expects about 10 hours of work per week when projects are active.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$55/hr
  • rubric design
  • assessment standards
  • high school pedagogy
Education & TrainingView job

Mercor

Audiobook QA Expert — Portuguese (Portugal)

Assess AI-narrated audiobooks in European Portuguese with the perspective of a regular listener and the precision of a reviewer. You’ll identify speech errors, mark their exact locations in review tools, and report how natural and enjoyable each recording feels. The remote, part-time role calls for about 20 hours per week, or roughly four hours per day.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$15–$20/hr
  • european portuguese
  • audiobook evaluation
  • audio annotation
Language & LinguisticsView job

Handshake AI

Reservoir Engineer

Use your energy industry experience to create expert training material and assess AI-generated content about reservoir engineering. You’ll draw on hands-on knowledge of subsurface analysis, production operations, and relevant industry tools to judge accuracy and relevance. The work is remote, project-based, and hourly, with a flexible schedule and no minimum hour requirement. Contributors typically work about 5–20 hours per week during active projects. No AI experience is needed.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $80/hr
  • reservoir engineering
  • subsurface analysis
  • production operations
Sales Engineering & Solutions ConsultingView job

SME Careers

Danish Language Expert

Review AI-generated Danish and create reference answers that demonstrate accurate, natural writing. You will assess grammar, meaning, tone, register, and cultural fit, then explain issues and compare model responses. The role calls for native or near-native Danish, English at C1 or above, and at least three years of relevant language-focused experience or equivalent expertise.

Location and eligibility
Remote · Denmark, Germany, Greenland
Engagement type
Contract
Compensation
Up to $50/hr
  • danish
  • english
  • danish grammar
Language & LinguisticsView job

micro1

Defense Analyst

As a civilian defense analyst, you’ll assess AI-generated scenarios about military operations, armed conflict, and defense decisions. You’ll check operational assumptions and military capabilities for accuracy, review civilian protection and international humanitarian law considerations, then write structured feedback that helps improve the system’s reasoning and reliability.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$80–$170/hr
  • military operations analysis
  • defense research
  • conflict analysis
CybersecurityView job

AfterQuery

Plumber Expert

Use your plumbing experience to create realistic diagnostic scenarios and assess how AI models handle trade work. You’ll write explanations grounded in plumbing codes, then judge model responses for safety, code compliance, and workmanship. The work happens from home on an async, independent-contractor basis, with a minimum commitment of 10 hours per week and no stated maximum.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$70/hr
  • plumbing
  • plumbing codes
  • upc
AI evaluationView job

Mercor

Wholesale and Manufacturing Sales Representative

Use your background in B2B wholesale and manufacturing sales to assess AI-generated sales content and workflows. The project starts immediately and runs about 4–6 weeks. You can work remotely and must commit at least 20 hours per week. Payment starts on a task basis after approval of your first task; completing that task within the required timeline qualifies you for hourly pay for the rest of the project.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$110/hr
  • b2b sales
  • wholesale sales
  • manufacturing sales
Sales & Business DevelopmentView job

Handshake AI

Drilling Engineer

Use your drilling and energy operations experience to create expert training data and assess AI-generated answers for accuracy and relevance. The work draws on knowledge of drilling workflows, well planning, and energy data tools. It is remote and project-based, with a flexible schedule and no minimum hours. Contributors often work 5–20 hours per week during active projects; future placements depend on project needs. No AI experience is required.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • drilling operations
  • drilling engineering
  • completions
Data EngineeringView job

SME Careers

C Team Lead

Lead quality checks for C programming work used in AI training projects. You will review generated code and contributor evaluations for correctness, compilation, memory safety, portability, and clear technical explanations, then coach contributors and maintain QA resources. This is a remote contract opportunity with no immediate project; qualified candidates may be contacted when relevant work becomes available.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $75/hr
  • c
  • c programming
  • code review
Quality Assurance & TestingView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.