AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

AfterQuery

Clinical & Biomedical Measurement Scientist

Use your experience with physiological or clinical recordings to create research-level problems that test and train AI models. The work draws on measurements you have collected and analyzed, rather than clinical practice without data analysis or machine learning based only on public datasets. Experts work remotely as independent contractors, choose how many tasks to accept, and complete standard background and identity verification.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • python
  • matlab
  • r
Science & ResearchView job

Handshake AI

Biology Expert, PhD

Use advanced training in biology to assess AI-generated material and give feedback on biological concepts, experimental design, scientific reasoning, and technical problem-solving. The work is remote, asynchronous, and project-based, with no minimum hour requirement. During active projects, contributors typically work about 5–20 hours per week; placement depends on project needs, with consideration for future projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$150/hr
  • biology
  • biological concepts
  • experimental design
Science & ResearchView job

Turing

Business Analyst - US

Analyze chatbot responses and evaluate them against business requirements.

Location and eligibility
Remote · United States only
Engagement type
Freelance
Compensation
Pay not listed
  • business analysis
  • requirements gathering
  • process mapping
Business Analysis & StrategyView job

Ethos

Policy Researcher / Think Tank Analyst

Help train a foundational AI lab’s language model by creating, assessing, and refining professional policy presentations. You’ll draw on experience producing policymaker-facing briefs and slides across policy briefings, data exhibits, testimony support, report launches, and stakeholder updates. The role is remote with a flexible schedule; task volume varies, and most experts work under 10 hours per week, with no weekly cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • policy research
  • think tank analysis
  • policy briefs
Data Science & AnalyticsView job

Google DeepMind · via Braintrust

Credit Research Analyst / Investment Analyst

Use your investment research experience to assess AI-generated analysis of companies, markets, and investment opportunities. You’ll review equity, fixed-income, credit, and fundamental research, then flag errors, weak reasoning, unsupported claims, and gaps. Your feedback will help improve AI systems’ ability to produce research that meets institutional standards. Applicants must be based in the United States.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$145/hr
  • credit risk
  • credit analysis
  • equity research
Market Research & InsightsView job

SME Careers

Public Health Expert

Use your epidemiology and public health expertise to assess AI-generated answers or write reference prompts and model responses. You will check population-health reasoning, evidence interpretation, surveillance logic, and recommendations for accuracy, clarity, and safety. This remote, hourly contract requires at least five years of professional public health experience and C1 English proficiency; qualified experts may be contacted when relevant projects arise.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $70/hr
  • public health
  • epidemiology
  • biostatistics
Health Informatics & Medical RecordsView job

Mercor

Mathematics Domain Expert

Use your research expertise to assess mathematical reasoning in AI model outputs and shape the standards used to judge correctness. You will write rigorous problem specifications, reference solutions, and proofs, then build evaluation sets in your area of specialization. The role is fully remote and requires a United States base.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$90–$140/hr
  • mathematics
  • applied mathematics
  • statistics
Machine Learning & AIView job

micro1

Independent Professional & Solopreneur (Domain Expert)

Independent professionals and solopreneurs will apply their domain knowledge to assess real-world work and improve AI training materials. The project focuses on how AI handles practical tasks, including proposals, reports, client communications, and analyses. Prior AI experience is not needed. The role is remote and open to people in the US and Canada.

Location and eligibility
Remote · Canada, United States
Engagement type
Contract
Compensation
$40–$120/hr
  • domain-expertise
  • client-relationship-management
  • written-communication
Machine Learning & AIView job

AfterQuery

Field Ecologist & Wildlife/Fisheries Biologist

Use firsthand experience with population data to create research-level problems that test and train AI models. The work draws on field surveys, tagging and telemetry, or fisheries catch and age data that you have collected and analyzed. This remote, flexible contract has no fixed weekly schedule, and accepted experts complete standard background and identity verification.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • python
  • r
  • ecology
Science & ResearchView job

Handshake AI

Quantitative Analyst

Use your quant experience on an ongoing, project-based effort to improve AI research. You’ll create realistic quantitative challenges, assess model answers for accuracy and practical value, and write feedback that reflects how working quants approach research, modeling, and strategy. Set your own pace with no fixed schedule or minimum hours, alongside your current role.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$150/hr
  • quantitative analysis
  • quant research
  • alpha generation
Data Science & AnalyticsView job

Turing

Business Analyst (Finance)

Evaluate finance model outputs and identify performance gaps.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • corporate finance
  • investment banking
  • financial analysis
Business Analysis & StrategyView job

Ethos

Market Research / Competitive Intelligence Analyst

Help a foundational AI lab train its latest language model by creating, evaluating, and refining professional research materials across documents, spreadsheets, and slide decks. Work remotely on your own schedule, with task volume shaping available hours. Most experts work under 10 hours per week, though no weekly hours cap applies. The work can start as soon as possible.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • market research
  • competitive intelligence
  • competitive landscape analysis
Market Research & InsightsView job

Google DeepMind · via Braintrust

AML / KYC Investigator / Financial Crime Compliance

Use your financial crime investigation experience to assess how AI systems analyze suspicious activity, transaction monitoring alerts, and fraud scenarios. You’ll review casework and AI-generated conclusions for accuracy, sound risk judgment, and consistency with established practices, then explain gaps and missed indicators through structured feedback. Applicants need at least four years of relevant professional experience and must be based in the United States.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$145/hr
  • aml
  • kyc
  • transaction monitoring
Data Science & AnalyticsView job

SME Careers

SQL Team Lead

Lead quality checks for SQL and database content used in AI training projects. You will review generated queries and explanations, assess contributor work against project rubrics, and guide trainers and QAs through feedback, documentation, and onboarding. This is a remote contract role with no immediate project; qualified candidates may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $70/hr
  • sql
  • mysql
  • postgresql
Data EngineeringView job

Mercor

Biology & Life Sciences Domain Expert

Bring senior research expertise to the evaluation of AI systems in biology and the life sciences. You will assess scientific tasks and model responses, create precise problem specifications and reference solutions, and build research-level benchmarks in your specialty. The role suits a practicing specialist who can distinguish sound scientific reasoning from claims that only sound convincing.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$90–$140/hr
  • biology
  • life sciences
  • biochemistry
Science & ResearchView job

micro1

AI Safety & Evaluation Specialist

Evaluate how personal AI agents handle sensitive information through privacy-focused tests and response reviews. The work centers on spotting improper disclosures and data-protection risks, then recording evidence-based feedback. This is a United States-based, part-time contractor project lasting six weeks. Applicants complete an AI interview; no other assessments are required.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$30–$50/hr
  • privacy risk assessment
  • data protection
  • ai evaluation
Data Science & AnalyticsView job

AfterQuery

Operations Research & Applied Mathematics Specialist

Use your experience with operations research, applied mathematics, or a related field to create research-level problems that test and train AI models. You’ll work with real operational data, such as data from supply chains, scheduling, or physical processes. The contract is remote and task-based, with no fixed weekly schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • operations research
  • applied mathematics
  • python
Machine Learning & AIView job

Handshake AI

Quantitative Finance Researcher

Use your background in quantitative finance to create expert training material and assess AI-generated responses for accuracy and relevance. You’ll contribute feedback that helps AI systems handle quantitative finance research and methods. The work is remote, project-based, and hourly, with a flexible schedule and no minimum hours. Contributors typically work about 5–20 hours a week during active projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$75–$150/hr
  • quantitative finance
  • mathematical finance
  • financial engineering
Finance & AccountingView job

Turing

SWE Bench – Data Engineer/Data Scientist

Build and validate data pipelines for AI performance evaluation projects.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • data engineering
  • data science
Data EngineeringView job

Outlier · via Braintrust

Senior Finance & Operations Experts - AI Benchmarking

Create realistic finance and operations challenges that help benchmark AI systems. You’ll build scenarios from professional workflows, set clear criteria for correct results, and assess proposed answers for accuracy and sound reasoning. The project expects 20 hours of work per week for 1–6 months and pays $1,350 per task.

Location and eligibility
Remote · Eligible in 25 countries
Engagement type
Contract
Compensation
$1,350 fixed
  • finance
  • operations
  • compliance
Machine Learning & AIView job

Showing 20 active roles of 87. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.