AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Mercor

Expert Interviewer

Support a frontier AI lab’s expert panel by interviewing shortlisted engineers for an AI training and evaluation engagement. You’ll lead structured, roughly 20-minute conversations focused on GPU kernel development, security and vulnerability research, and ML compiler and accelerator work, then share evidence-based assessments of each expert’s fit.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$50–$60/hr
  • technical interviewing
  • technical recruiting
  • gpu kernel development
Machine Learning & AIView job

SME Careers

Estonian Language Expert

Review AI-generated Estonian responses and create reference answers that show strong grammar, natural phrasing, and accurate meaning. You will compare model outputs, check claims and cultural context, and explain language issues in written English. The role is a remote hourly contract for candidates with native or near-native Estonian and professional English at C1 or higher.

Location and eligibility
Remote · Estonia only
Engagement type
Contract
Compensation
Up to $35/hr
  • estonian
  • english
  • copyediting
Language & LinguisticsView job

Mercor

Bilingual Chinese Generalist Expert — AI Safety

Help assess how advanced AI models respond to sensitive topics in Chinese. You’ll write Chinese prompts, classify conversations against structured guidelines, and explain judgments about adversarial wording and escalation patterns. The role requires Chinese fluency and business-level written English, but no AI or machine learning background. Training covers the review workflow, and the project starts immediately.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$48–$52/hr
  • chinese
  • english
  • prompt writing
Language & LinguisticsView job

SME Careers

History Quality Assurance Lead (QAL)

Lead quality checks across history-focused AI training projects by reviewing model responses and contributor work against project rubrics. You will assess accuracy, chronology, sourcing, context, and bias, then guide trainers and QA reviewers through feedback, onboarding, and project documentation. This is a remote contract role with no immediate project; qualified experts may be contacted when relevant work becomes available.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $50/hr
  • history
  • historical research
  • historiography
Quality Assurance & TestingView job

Mercor

Audiobook QA Expert — German

Assess German (Germany) text-to-speech audiobooks from a listener’s perspective, checking whether the narration sounds natural, accurate, and enjoyable. You’ll mark speech errors and audio artifacts in review tools, then report how each issue affects the listening experience. The work is remote and part-time, with an expected commitment of about 20 hours per week. Applicants can live anywhere, though Germany or another German-speaking region is preferred.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$15–$20/hr
  • german
  • audiobook evaluation
  • text-to-speech
Language & LinguisticsView job

SME Careers

Arabic Team Lead

Guide quality across Arabic AI training projects by reviewing Arabic content and contributor work against project rubrics. You will give specific feedback, align remote trainers and QA reviewers, and maintain Arabic style guides and onboarding materials. The work calls for near-native Arabic, strong English, and 3+ years in language or quality workflows. No project is active now; qualified candidates may be contacted for future work.

Location and eligibility
Remote · Egypt, Saudi Arabia
Engagement type
Contract
Compensation
Up to $40/hr
  • arabic
  • modern standard arabic
  • arabic grammar
Language & LinguisticsView job

Mercor

Machine Learning Engineer Talent Network

Mercor’s talent network connects machine learning engineers with future contract projects at AI labs and companies. Complete your profile and pass an AI interview to qualify for project matching as opportunities arise. Work may involve model development, evaluation, and research support, with typical commitments of 15–30 hours per week. Project scope and duration vary, and you can consider invitations that fit your schedule and interests.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70–$250/hr
  • machine learning
  • python
  • pytorch
Machine Learning & AIView job

SME Careers

Talent Assessment Specialist - Bangladesh

Review candidate CVs and recorded AI interviews to support hiring decisions across technical and non-technical roles. You will assess qualifications, identify relevant experience, and write structured recommendations that help maintain fair, consistent hiring evaluations. The role requires fluent English, a bachelor’s degree or higher, and a personal computer suitable for reviewing candidate materials and completing evaluation work.

Location and eligibility
On-site · Bangladesh only
Engagement type
Contract
Compensation
Up to $4/hr
  • candidate assessment
  • cv screening
  • english proficiency
Talent Acquisition & RecruitingView job

Mercor

Legal Domain Expert — AI Training & Evaluation

Cincinnatus LLC employs a senior legal specialist in a full-time W-2 role supporting a leading AI lab’s research and program teams. You will assess legal tasks and model responses, write task instructions and reference solutions, and build evaluations grounded in professional legal practice. The hybrid position requires Bay Area residence and on-site work several days each week when needed. The initial commitment runs for six months at 40 hours per week.

Location and eligibility
Hybrid · United States only
Engagement type
Full-time
Compensation
$60–$100/hr
  • legal practice
  • legal research
  • legal analysis
LegalView job

SME Careers

Spanish Team Lead

Lead Spanish quality checks across AI training projects by reviewing generated content and contributor work against project rubrics. You will coach trainers and QA reviewers, answer language questions, and maintain Spanish-specific guides and trackers. This remote contract has no immediate project; qualified candidates may hear about future assignments. The selection process includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · Mexico, Spain, United States
Engagement type
Contract
Compensation
Up to $40/hr
  • spanish
  • english
  • ai training
Language & LinguisticsView job

Mercor

Agent Engineer

Mercor seeks engineers with hands-on experience building and running LLM agents in production and direct insight into how people use them inside a company. The conversation will focus on agent reliability, evaluation, adoption, and the tradeoffs behind real systems, including internal assistants, company data and memory, tools and MCP, and visibility into agent activity and costs.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Task-based
Compensation
$500 fixed
  • llm agents
  • agent reliability
  • agent evaluation
Machine Learning & AIView job

SME Careers

Astronomer Quality Assurance Lead (QAL)

Guide quality across astronomy and astrophysics AI training projects by reviewing scientific content and contributor work against project rubrics. You will assess physical reasoning, calculations, units, observational context, and clarity, then coach trainers and QAs, maintain review materials, and support contributor onboarding in a remote workflow.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $110/hr
  • astronomy
  • astrophysics
  • cosmology
Quality Assurance & TestingView job

Mercor

AI Developer Trace Task Auditor

Review coding sessions created with AI developer tools for a frontier AI lab’s model training and evaluation work. You’ll judge whether each trace reaches a correct result, follows a sound development process, and shows sound reasoning. Your written feedback should explain your assessment and follow the provided rubric.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$90/hr
  • software development
  • ai-assisted coding
  • cursor
Quality Assurance & TestingView job

SME Careers

Go Team Lead

Lead quality checks for Go AI training work, reviewing generated code and contributor submissions against project rubrics. You will coach trainers and QAs, address recurring defects, and maintain guidance for safe, idiomatic code. This remote contract has no immediate project; qualified candidates may be contacted when a suitable assignment opens. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $70/hr
  • go
  • golang
  • backend development
Quality Assurance & TestingView job

Mercor

Graphic & UX/UI Designer Talent Network

Mercor’s talent network connects experienced graphic and UX/UI designers with future contract projects at AI labs and companies. After you complete your profile and pass an AI interview, Mercor may match you with work as projects arise. Assignments can cover model training and evaluation, design tasks based on real-world scenarios, and expert feedback for AI research. Typical projects call for 15–30 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$80/hr
  • user experience research
  • interface design
  • graphic design
UX/UI & Product DesignView job

SME Careers

Mathematics Specialist

Review AI-generated math solutions for correct calculations, sound methods, and clear reasoning. You will compare responses, verify quantitative claims with public sources, and write explanations that show how to reach a valid result. The role calls for advanced expertise in pure and applied mathematics and strong English writing. No project is active now; qualified experts may hear about future assignments through the expert network.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $70/hr
  • mathematics
  • pure mathematics
  • applied mathematics
Machine Learning & AIView job

Boron · via Mercor

Multilingual Inpatient Hospitalist (MD) — Clinical Documentation & AI Evaluation

A healthcare AI partner needs practicing inpatient hospitalists to assess hospital documentation and AI-generated notes. You will review H&Ps, progress notes, and discharge summaries, annotate encounter data, and provide clinical feedback. Applicants must hold an MD, practice inpatient medicine in the US, and speak, listen, and write English plus another listed language at C1 level or higher.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$170/hr
  • inpatient medicine
  • hospital medicine
  • clinical documentation
Health Informatics & Medical RecordsView job

Mercor

Accounting & Audit Domain Expert

A senior accounting specialist will help a leading AI lab assess and improve how its models handle real accounting and audit work. You’ll review model outputs, write task instructions and reference solutions, and build evaluation sets with research teams. Cincinnatus LLC employs this full-time W-2 role. You must live in the Bay Area or relocate at your own cost, and work on-site multiple days each week when required. The initial engagement runs for six months at 40 hours per week.

Location and eligibility
Hybrid · United States only
Engagement type
Full-time
Compensation
$60–$100/hr
  • accounting
  • auditing
  • financial reporting
Finance & AccountingView job

Mercor

Insurance Domain Expert

A senior insurance or actuarial specialist will help a leading AI lab assess how its models handle real insurance work. You will review model outputs, create reference solutions and evaluation tasks, and set clear standards for sound insurance reasoning. Cincinnatus LLC employs this full-time W-2 role, with placement alongside the client’s research team. The role requires Bay Area residence and on-site work multiple days each week when required.

Location and eligibility
Hybrid · United States only
Engagement type
Full-time
Compensation
$60–$100/hr
  • insurance
  • actuarial science
  • large language models
Finance & AccountingView job

Mercor

Audiobook QA Expert — French

Assess French (France) AI-narrated audiobooks from the perspective of a regular listener, while tracking speech accuracy, naturalness, and listening experience. You’ll mark specific errors in review tools and share where narration works or disrupts the story. The remote, part-time role calls for about 20 hours per week, or roughly four hours a day. Applicants may live anywhere; France or another French-speaking region is preferred.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$15–$20/hr
  • french
  • english
  • audiobook quality assurance
Language & LinguisticsView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.