AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Leading AI Lab · via Braintrust

Conduct & Communications Surveillance Analyst – AI Evaluation

Use your surveillance investigation experience to build realistic cases that assess whether AI can interpret trade records and employee communications, identify relevant evidence, and reach a defensible conclusion. You’ll create fictional-firm scenarios that test the distinction between potential misconduct and legitimate activity, including cases with incomplete records or competing explanations.

Location and eligibility
Remote · Eligible in 11 countries
Engagement type
Contract
Compensation
$70–$90/hr
  • regulatory compliance
  • risk management
  • trade surveillance
Market Research & InsightsView job

SME Careers

Public Health Expert

Use your epidemiology and public health expertise to assess AI-generated answers or write reference prompts and model responses. You will check population-health reasoning, evidence interpretation, surveillance logic, and recommendations for accuracy, clarity, and safety. This remote, hourly contract requires at least five years of professional public health experience and C1 English proficiency; qualified experts may be contacted when relevant projects arise.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $70/hr
  • public health
  • epidemiology
  • biostatistics
Health Informatics & Medical RecordsView job

micro1

Professional Shopper

Research products across categories, compare prices and competing options, and share grounded insights about consumer preferences. Your findings will help train AI systems, and you will review generated answers for accuracy against product information. Shopping and product expertise matter; prior AI experience is not required.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$20–$44/hr
  • Product Research
  • Price Comparison
  • Consumer Insights
Market Research & InsightsView job

Mercor

Scientific / ML Engineer

Work on AI training data by creating and reviewing technical problems in machine learning and scientific computing. You will assess model training, experiments, data pipelines, and simulations, then provide solutions and feedback grounded in sound methodology. Cincinnatus LLC employs this part-time W-2 role and may place you with a leading AI lab as part of its extended workforce.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$90–$140/hr
  • machine learning
  • scientific computing
  • python
Machine Learning & AIView job

Handshake AI

Pricing Analyst

Use your retail pricing experience on an ongoing, project-based AI research opportunity. You’ll create training scenarios, assess AI responses against real pricing and markdown practices, and write feedback to guide model improvement. The part-time work is remote and self-scheduled, with no set hours or minimum hour requirement, so you can take it on alongside your current work.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail pricing
  • price management
  • pricing strategy
Data Science & AnalyticsView job

Turing

Business Analyst - US

Analyze chatbot responses and evaluate them against business requirements.

Location and eligibility
Remote · United States only
Engagement type
Freelance
Compensation
Pay not listed
  • business analysis
  • requirements gathering
  • process mapping
Business Analysis & StrategyView job

Ethos

Data Scientist

Help a foundational AI lab train a language model on data science documentation. You’ll review and assess documents, checking whether their content and structure match materials data scientists encounter in practice. The role suits experienced practitioners with current, hands-on knowledge of data science documents. Prior AI experience is not required. Work is remote, and weekly hours depend on client task volume; most experts work under 10 hours a week, with no weekly cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$100/hr
  • data science
  • machine learning
  • python
Data Science & AnalyticsView job

AfterQuery

Enterprise Operations / Domain Analyst

AfterQuery is assembling senior experts in supply chain, finance, and compliance to assess how frontier AI models handle complex, real-world questions. You will shape the standards for correct, high-quality work by creating domain-specific problems, writing reference answers and rubrics, and judging model responses. The role centers on research and evaluation, not production engineering, and calls for 8–12 years of field experience and a bachelor's degree.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • supply chain
  • enterprise operations
  • finance
Enterprise Systems (ERP/CRM)View job

Leading AI Lab · via Braintrust

EU Regulatory Reporting Specialist – AI Evaluation

Use your experience with EU regulatory returns to create practical cases that test AI on reporting decisions. You’ll build scenarios for fictional banks, insurers, or other firms, then work through large datasets with spreadsheets and Python to check calculations and confirm the correct template values under the rules in force on a given reporting date.

Location and eligibility
Remote · Eligible in 28 countries
Engagement type
Contract
Compensation
$75–$90/hr
  • regulatory reporting
  • data validation
  • microsoft excel
Enterprise Systems (ERP/CRM)View job

SME Careers

Data Scientist Team Lead

As a Data Scientist Quality Assurance Lead, you will review AI-generated data science work and contributor submissions for statistical soundness, code accuracy, reproducibility, and rubric fit. You will guide trainers and QAs, resolve technical questions, and maintain calibration and onboarding resources. This remote contract role has no immediate project; qualified experts may be contacted when relevant work becomes available.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $110/hr
  • data science
  • data science quality assurance
  • llm evaluation
Data Science & AnalyticsView job

micro1

Veterans Intelligence Expert

Review AI-generated military intelligence content for sound analysis, credible scenarios, and defensible operational reasoning. You’ll assess threat assessments and planning, spot unsupported conclusions, and document feedback on how models handle uncertainty and conflicting information. The work draws on military intelligence expertise to evaluate AI systems.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$50–$100/hr
  • military intelligence analysis
  • threat assessment
  • operational planning
Machine Learning & AIView job

Mercor

Business Operations / Knowledge Work Specialist

Bring business operations and professional knowledge-work expertise to AI training. You’ll create and assess realistic business tasks, workflows, and reference materials, then give research and engineering teams feedback that helps improve model performance. Cincinnatus LLC employs this part-time role on a W-2 basis and may place you within a leading AI lab’s extended workforce. You must be available at least 20 hours each week on weekdays.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$50–$80/hr
  • business operations
  • strategy
  • program management
Business Analysis & StrategyView job

Handshake AI

Regulatory Analyst

Use your energy industry experience to create training material and assess AI-generated responses about regulation, rate cases, and regulatory reporting. You’ll contribute feedback on accuracy and relevance, drawing on the tools and workflows you use in your work. The project is remote, asynchronous, and flexible, with no minimum hours; active projects typically draw 5–20 hours per week.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • energy regulation
  • rate analysis
  • rate case analysis
Data Science & AnalyticsView job

Turing

Business Analyst (Finance)

Evaluate finance model outputs and identify performance gaps.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • corporate finance
  • investment banking
  • financial analysis
Business Analysis & StrategyView job

Ethos

Market Research / Competitive Intelligence Analyst

Help a foundational AI lab train its latest language model by creating, evaluating, and refining professional research materials across documents, spreadsheets, and slide decks. Work remotely on your own schedule, with task volume shaping available hours. Most experts work under 10 hours per week, though no weekly hours cap applies. The work can start as soon as possible.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • market research
  • competitive intelligence
  • competitive landscape analysis
Market Research & InsightsView job

AfterQuery

Research Scientist — Formal Methods / Computational Science

Join a research cohort of senior experts across mathematics, physics, chemistry, and biology. You’ll set standards for correct, high-quality reasoning on demanding real-world problems, then use those standards to assess frontier AI models. The work centers on research and evaluation, not production engineering. Applicants need a PhD or doctorate and at least 10 years of experience.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • formal methods
  • computational science
  • mathematics
Science & ResearchView job

Google DeepMind · via Braintrust

Commodities Research Analyst

Use your commodities expertise to assess how AI systems interpret global markets and forecast prices. You’ll review market analysis, supply and demand fundamentals, pricing models, and forecast assumptions across energy, metals, or agriculture. The work calls for hands-on research, strategy, or trading experience, plus the ability to judge market reasoning and give structured feedback.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$145/hr
  • commodities research
  • commodity markets
  • energy
Market Research & InsightsView job

SME Careers

SQL Team Lead

Lead quality checks for SQL and database content used in AI training projects. You will review generated queries and explanations, assess contributor work against project rubrics, and guide trainers and QAs through feedback, documentation, and onboarding. This is a remote contract role with no immediate project; qualified candidates may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $70/hr
  • sql
  • mysql
  • postgresql
Data EngineeringView job

micro1

Equity & Credit Research Expert

Use your financial research expertise to assess company statements, market data, and investment scenarios for an AI training project. You will develop equity and credit commentary, review research materials, and provide examples and feedback that help shape useful training data. Prior AI experience is not required; the role calls for strong knowledge of financial markets and analysis.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$90–$120/hr
  • financial analysis
  • equity research
  • credit research
Market Research & InsightsView job

Mercor

Technical and Scientific Sales Representative

Use your B2B technical sales experience to assess AI-generated sales content and workflows for technical and scientific products. The project starts immediately and runs for about 4–6 weeks. You must be available for at least 20 hours per week. Payment starts on a task basis after approval of your first task; completing that task within the required timeline qualifies you for hourly pay for the rest of the project.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$110/hr
  • b2b sales
  • technical sales
  • wholesale sales
Sales Engineering & Solutions ConsultingView job

Showing 20 active roles of 71. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.