AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Google DeepMind · via Braintrust

OCaml & Functional Programming Expert

Review AI-generated OCaml code and judge whether each solution works, meets its technical requirements, and follows functional programming principles. You’ll assess type safety, performance-sensitive implementations, benchmarks, and test cases, then give structured feedback that helps improve AI coding capabilities. Applicants need 3+ years of relevant professional experience and must be based in the United States.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$145/hr
  • ocaml
  • functional programming
  • type systems
AI evaluationView job

Mercor

Clinical Development & Operations Expert

Work remotely from the United States on AI training for clinical development. You will shape realistic trial scenarios, assess model responses against clinical standards and real-world practice, and help research and engineering teams improve model performance. Cincinnatus LLC employs this full-time role on a W-2 basis, with a 40-hour weekday commitment and placement within a leading AI lab.

Location and eligibility
Remote · United States only
Engagement type
Full-time
Compensation
$70–$100/hr
  • clinical development
  • clinical operations
  • clinical trial design
Health Informatics & Medical RecordsView job

Handshake AI

Civil Engineering Expert

Use your civil or structural engineering experience to assess AI-generated engineering work. You’ll write realistic problems based on design, modeling, estimating, and project work, then check model responses for technical accuracy and practical feasibility. The ongoing work is project-based, part-time, and self-scheduled, with no minimum hour requirement.

Location and eligibility
Remote · Canada, United States
Engagement type
Part-time
Compensation
$62.5/hr
  • civil engineering
  • structural engineering
  • engineering design
EngineeringView job

SME Careers

Malayalam Team Lead with Mathematical Background

Guide Malayalam quality across AI training projects by reviewing model outputs and contributor work against project rubrics. You will coach trainers and QA reviewers, resolve language questions, and maintain materials such as Malayalam style guides and quality trackers. The role calls for a mathematics degree, strong Malayalam and English, and at least three years in a relevant language or review workflow. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • malayalam
  • english
  • mathematics
Language & LinguisticsView job

micro1

Veterans Combat and Defense Expert

Work with a customer project focused on military operations, defense strategies, and operational decisions. You will create and assess realistic scenarios, judge AI-generated material against military doctrine and real-world practice, and document findings that inform model evaluation and improvement. The role is remote and engages U.S. military veterans with relevant combat, defense, or operational backgrounds.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$50–$100/hr
  • military operations expertise
  • operational planning
  • tactical decision-making
Machine Learning & AIView job

Terac

Technology Leaders: Interview on AI Platform Evaluation

Share your experience evaluating AI platforms in a paid, 60-minute remote video interview with a research team. The conversation will cover how your organization assesses AI tools, which technical and business criteria guide decisions, who takes part, and what challenges arise during evaluation. Professionals from the USA, Canada, Great Britain, Australia, and New Zealand may participate.

Location and eligibility
Remote · Eligible in 5 countries
Engagement type
Contract
Compensation
Pay not listed
  • ai evaluation
  • artificial intelligence
  • engineering leadership
Machine Learning & AIView job

Ethos

Academic Researcher / Postdoctoral Fellow

Help a foundational AI lab train its language model to produce professional research presentations. You will create, assess, and refine AI-generated slide decks and related materials across research communication workflows. The work draws on active academic research, conference presentations, and strong PowerPoint skills. Work remotely on your own schedule; task volume varies, and hours are not guaranteed.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • powerpoint
  • academic research
  • conference presentations
Machine Learning & AIView job

Turing

Senior Python Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • c++
  • c
Machine Learning & AIView job

AfterQuery

Operations Research & Applied Mathematics Specialist

Use your experience with operations research, applied mathematics, or a related field to create research-level problems that test and train AI models. You’ll work with real operational data, such as data from supply chains, scheduling, or physical processes. The contract is remote and task-based, with no fixed weekly schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • operations research
  • applied mathematics
  • python
Machine Learning & AIView job

Meridial by Invisible

Audio Evaluations: JSON & Coding Expert (German, Germany)

Review AI-generated coding, technical customer service, virtual agent, JSON, and audio-related content. You’ll check technical accuracy, clarity, natural German, and usefulness against project guidelines. The role calls for native-level German as used in Germany, but you do not need to live there. You’ll complete a German fluency introduction and a JSON Skills Assessment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$11/hr
  • german
  • json
  • coding
Language & LinguisticsView job

Google DeepMind · via Braintrust

Commodities Research Analyst

Use your commodities expertise to assess how AI systems interpret global markets and forecast prices. You’ll review market analysis, supply and demand fundamentals, pricing models, and forecast assumptions across energy, metals, or agriculture. The work calls for hands-on research, strategy, or trading experience, plus the ability to judge market reasoning and give structured feedback.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$145/hr
  • commodities research
  • commodity markets
  • energy
Market Research & InsightsView job

General Translation · via Mercor

Hebrew Linguistic Expert

Assess Hebrew output from a large language model across translation, summaries, dialogue, and grammar correction. You’ll also refine and annotate Hebrew text, then share linguistic findings with AI researchers to support model training. The project centers on Hebrew language quality, cultural fit, and the model’s ability to understand and generate natural text.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • hebrew
  • english
  • translation
Language & LinguisticsView job

Handshake AI

Regulatory Analyst

Use your energy industry experience to create training material and assess AI-generated responses about regulation, rate cases, and regulatory reporting. You’ll contribute feedback on accuracy and relevance, drawing on the tools and workflows you use in your work. The project is remote, asynchronous, and flexible, with no minimum hours; active projects typically draw 5–20 hours per week.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • energy regulation
  • rate analysis
  • rate case analysis
Data Science & AnalyticsView job

SME Careers

Punjabi Team Lead with Mathematical Background

Lead Punjabi quality review across AI training projects, checking contributor work and generated content against project rubrics. You will guide trainers and QAs, resolve language questions, and maintain resources such as style guides and onboarding materials using Discord, Google Docs, and Google Sheets. The contract role requires a mathematics degree, strong Punjabi and English, and at least three years of related professional experience. The selection process includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · Canada, India, Pakistan
Engagement type
Contract
Compensation
Up to $25/hr
  • punjabi
  • english
  • mathematics
Language & LinguisticsView job

micro1

Veterans Legal and Human Rights Expert

A U.S. military veteran with expertise in military law, operational law, or human rights will assess legal and ethical issues in military operations, armed conflict, and security work. You’ll create and review scenarios, judge AI-generated legal analysis, and document findings for AI model evaluation. The work calls for sound knowledge of LOAC, ROE, and international humanitarian law.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$50–$100/hr
  • military law
  • operational law
  • international humanitarian law
LegalView job

Terac

Industrial Engineers: Equipment Diagnostics and Sensor Data Analysis

Terac is conducting a paid study on industrial equipment diagnostics and sensor data analysis. You’ll review equipment data and diagnostic outputs, explain how you assess equipment health, and judge whether automated workflows produce accurate, reliable evaluations. The study is remote and open to candidates in the listed eligible countries.

Location and eligibility
Remote · Eligible in 146 countries
Engagement type
Contract
Compensation
Pay not listed
  • industrial engineering
  • equipment maintenance
  • reliability engineering
EngineeringView job

Ethos

Procurement / Vendor Management Lead

Help train a foundational AI lab’s language model by creating, assessing, and refining professional procurement materials. You’ll work across RFP and RFQ drafting, vendor evaluations, contract and SLA reviews, spend analysis, vendor risk, and category strategy. Work is remote and self-scheduled; task volume varies, hours are not guaranteed, and most experts work under 10 hours a week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$70/hr
  • procurement
  • sourcing
  • vendor management
Talent Acquisition & RecruitingView job

Turing

Business Analyst (German Language)

Analyze content and provide feedback to improve AI language models.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • business analysis
  • german
  • english
Business Analysis & StrategyView job

AfterQuery

Civil, Geotechnical & Structural Field Engineer

Use your experience with civil, geotechnical or structural field data to create research-level problems that test and train AI models. The work draws on real site and monitoring data, including settlement, pile and load tests, inspections, and instrumentation. AfterQuery offers remote, flexible contract work with no set weekly schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • python
  • civil engineering
  • geotechnical engineering
Machine Learning & AIView job

Meridial by Invisible

Kansai (Japan) Translation and Localization Expert

Use native-level Kansai fluency and knowledge of how people speak across the region to evaluate voice recordings and audio samples. You will record spoken content, compare recordings with written text, and judge accuracy, clarity, naturalness, and alignment with project guidelines. The work calls for a strong ear for Kansai pronunciation, accents, phrasing, tone, and cultural nuance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$9/hr
  • kansai
  • japanese
  • voice recording
Language & LinguisticsView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.