AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

SME Careers

Data Scientist

Review AI-generated data science reasoning, code, and model results, then create reference solutions that show sound quantitative methods. You will check statistical claims, modeling decisions, and prompt compliance, and compare answers for correctness and clarity. The work draws on Python, scikit-learn, and SQL expertise. This contract has no immediate project; qualified candidates may hear about future assignments.

Location and eligibility
Remote · Germany, India, United States
Engagement type
Contract
Compensation
Up to $100/hr
  • data science
  • python
  • pandas
Data Science & AnalyticsView job

Mercor

Business Intelligence Analyst Talent Network

Apply to Mercor’s network for potential Business Intelligence Analyst projects with AI labs and other companies. After you submit your profile and pass an AI interview, Mercor may match you with work as projects open. Experts help train and evaluate AI models, build deliverables from real-world scenarios, and provide feedback. Projects vary in length and scope, with typical commitments of 15–30 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70–$120/hr
  • sql
  • data querying
  • tableau
Data Science & AnalyticsView job

micro1

Federal Management & Program Analyst

Bring federal program and policy expertise to an AI evaluation project. You will write realistic agency scenarios, prepare reference materials, and assess work from other contributors against federal planning, evaluation, and reporting practices. The role draws on skills such as policy analysis, decision memo writing, and executive briefing preparation. No previous AI experience is required, but applicants must be based in the United States.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$60–$80/hr
  • federal program management
  • policy analysis
  • decision memo writing
Business Analysis & StrategyView job

AfterQuery

Tax Accountant Expert

Create and assess tax preparation and planning scenarios that test how AI models apply tax principles to real-world compliance and advisory questions. You will write challenges, review model answers against tax practices and IRS rules, and work with tax and technical experts to shape content that teaches as well as tests.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$113/hr
  • tax accounting
  • tax preparation
  • tax compliance
Finance & AccountingView job

Handshake AI

Financial Services Professionals

Financial services professionals with at least four years of experience can contribute to a year-round AI research program. Project work may include writing industry-specific prompts and reviewing large language model responses to help improve AI understanding of professional tasks and language. Work is remote, asynchronous, and flexible, with no minimum hours. Project placement depends on availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • financial services
  • credit authorization
  • financial risk
Finance & AccountingView job

Turing

Business Analyst (Korean Language)

Analyze content and improve AI models using Korean and English insights.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • korean
  • english
  • business analysis
Business Analysis & StrategyView job

SME Careers

Mathematics Specialist

Review AI-generated math solutions for correct calculations, sound methods, and clear reasoning. You will compare responses, verify quantitative claims with public sources, and write explanations that show how to reach a valid result. The role calls for advanced expertise in pure and applied mathematics and strong English writing. No project is active now; qualified experts may hear about future assignments through the expert network.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $70/hr
  • mathematics
  • pure mathematics
  • applied mathematics
Machine Learning & AIView job

Mercor

Finance Domain Expert — AI Training & Evaluation

A finance specialist will help a leading AI lab assess and improve how its models handle real financial work. You will review finance tasks and model responses, write task instructions and reference solutions, and shape benchmarks with the research team. The full-time W-2 role requires 40 hours per week for an initial six-month engagement and hybrid work in the Bay Area, with on-site attendance multiple days each week when required.

Location and eligibility
Hybrid · United States only
Engagement type
Full-time
Compensation
$60–$100/hr
  • finance
  • financial analysis
  • corporate finance
Finance & AccountingView job

micro1

Defense Analyst

As a civilian defense analyst, you’ll assess AI-generated scenarios about military operations, armed conflict, and defense decisions. You’ll check operational assumptions and military capabilities for accuracy, review civilian protection and international humanitarian law considerations, then write structured feedback that helps improve the system’s reasoning and reliability.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$80–$170/hr
  • military operations analysis
  • defense research
  • conflict analysis
CybersecurityView job

AfterQuery

Research Scientist — Formal Methods / Computational Science

Join a research cohort of senior experts across mathematics, physics, chemistry, and biology. You’ll set standards for correct, high-quality reasoning on demanding real-world problems, then use those standards to assess frontier AI models. The work centers on research and evaluation, not production engineering. Applicants need a PhD or doctorate and at least 10 years of experience.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • formal methods
  • computational science
  • mathematics
Science & ResearchView job

Handshake AI

GIS Analyst

Use your energy-sector experience in environmental assessment, GIS analysis, or renewable energy siting to create training data and review AI-generated content. You’ll assess accuracy and relevance, then give feedback on environmental workflows and geospatial data practices. The work is remote and project-based, with a flexible schedule, no minimum hours, and about 5–20 hours per week during active projects. Placement depends on project needs, with future projects also possible.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • environmental analysis
  • environmental assessment
  • gis
Data Science & AnalyticsView job

Turing

Business Analyst (Finnish Language)

Analyze content in Finnish and provide feedback to improve AI models.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • finnish
  • english
  • business analysis
Business Analysis & StrategyView job

Mercor

Biochemistry & Life Sciences Domain Expert

A senior life sciences specialist will help a leading AI lab assess and improve how its models reason about research. You will review scientific tasks and model responses, write task instructions and reference solutions, and design evaluation benchmarks. Cincinnatus LLC employs this full-time W-2 role, with placement alongside the client’s research teams. The position requires Bay Area residence and on-site work multiple days each week when required.

Location and eligibility
Hybrid · United States only
Engagement type
Full-time
Compensation
$65–$105/hr
  • biochemistry
  • molecular biology
  • cell biology
Science & ResearchView job

micro1

Senior Intelligence Analyst – National Security

Contribute senior intelligence expertise to an AI training and evaluation project covering national security, intelligence analysis, and government decision-making. You will assess AI-generated reports and scenarios for accuracy, realism, and analytical quality, drawing on skills in intelligence analysis, threat assessment, source evaluation, and critical thinking.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$80–$170/hr
  • intelligence analysis
  • threat assessment
  • analytical reasoning
Data Science & AnalyticsView job

AfterQuery

Energy Expert

Use your energy-sector experience to help test and train AI models on realistic work from utilities, oil and gas, and power production. You’ll build practical scenarios, examine operational data, and spot errors in AI responses that require professional judgment. The project is remote and part time, with flexible hours and hourly pay.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • energy analysis
  • utility operations
  • oil and gas
Energy & Power GenerationView job

Handshake AI

Generation Asset Analyst

Use your energy industry experience to create expert training data and assess AI-generated responses about industrial operations, plant performance, and energy asset management. The remote, project-based work has a flexible, asynchronous schedule with no minimum hours. Contributors often work about 5–20 hours per week during active projects, and placement depends on current project needs.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • industrial operations
  • plant performance
  • energy asset management
Energy & Power GenerationView job

Turing

Board Game Reasoning Expert (AI Training & Evaluation)

Create and evaluate board game tasks to enhance AI reasoning skills.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • board games
  • game design
  • game mechanics
Data Science & AnalyticsView job

Mercor

Excel Expert — General

Use broad, advanced Excel experience to help improve how AI models handle spreadsheet work. You will create realistic tasks and solutions, assess model responses, and give research teams feedback across business domains. Cincinnatus LLC employs this W-2 role and may place you within a leading technology company’s GenAI initiative. The schedule calls for 40 weekday hours per week through the end of September, then 20 hours per week.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$100/hr
  • microsoft excel
  • xlookup
  • index/match
Machine Learning & AIView job

micro1

Military Operations & Reporting SME

Use your military operations and DoD reporting knowledge to review reporting content and help train AI systems. You’ll assess accuracy, clarity, terminology, and reporting standards, then give written feedback and shape realistic training examples. Prior AI experience is not needed. The work is remote and supports a customer project.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$40–$80/hr
  • military operations expertise
  • dod reporting standards
  • report writing
Machine Learning & AIView job

AfterQuery

Public Sector Expert

Use your government or public agency experience to help train and assess AI models on practical public sector work. You’ll create realistic work problems, examine budget, grant and program reporting data, and catch errors in AI responses. The project offers remote, part-time work with flexible hours and hourly pay. Applicants need at least five years of relevant experience, so the role does not suit students or early-career professionals.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$70/hr
  • public sector
  • budget analysis
  • grant management
Data Science & AnalyticsView job

Showing 20 active roles of 87. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.