AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Handshake AI

AI Evaluation Specialist

Contribute to short-term AI research projects with leading AI labs by applying your academic knowledge to improve large language models in specific fields and topics. Work remotely with no minimum hour commitment. Handshake provides brief training, and you must pass one assessment before starting. Successful project work may qualify you for future projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$17/hr
  • large language models
  • ai evaluation
  • ai training
Machine Learning & AIView job

SME Careers

Malayalam Team Lead with Mathematical Background

Guide Malayalam quality across AI training projects by reviewing model outputs and contributor work against project rubrics. You will coach trainers and QA reviewers, resolve language questions, and maintain materials such as Malayalam style guides and quality trackers. The role calls for a mathematics degree, strong Malayalam and English, and at least three years in a relevant language or review workflow. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • malayalam
  • english
  • mathematics
Language & LinguisticsView job

micro1

Veterans Intelligence Expert

Review AI-generated military intelligence content for sound analysis, credible scenarios, and defensible operational reasoning. You’ll assess threat assessments and planning, spot unsupported conclusions, and document feedback on how models handle uncertainty and conflicting information. The work draws on military intelligence expertise to evaluate AI systems.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$50–$100/hr
  • military intelligence analysis
  • threat assessment
  • operational planning
Machine Learning & AIView job

Terac

Technology Leaders: Interview on AI Platform Evaluation

Share your experience evaluating AI platforms in a paid, 60-minute remote video interview with a research team. The conversation will cover how your organization assesses AI tools, which technical and business criteria guide decisions, who takes part, and what challenges arise during evaluation. Professionals from the USA, Canada, Great Britain, Australia, and New Zealand may participate.

Location and eligibility
Remote · Eligible in 5 countries
Engagement type
Contract
Compensation
Pay not listed
  • ai evaluation
  • artificial intelligence
  • engineering leadership
Machine Learning & AIView job

Ethos

Data Scientist

Help a foundational AI lab train a language model on data science documentation. You’ll review and assess documents, checking whether their content and structure match materials data scientists encounter in practice. The role suits experienced practitioners with current, hands-on knowledge of data science documents. Prior AI experience is not required. Work is remote, and weekly hours depend on client task volume; most experts work under 10 hours a week, with no weekly cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$100/hr
  • data science
  • machine learning
  • python
Data Science & AnalyticsView job

AfterQuery

Clinical & Biomedical Measurement Scientist

Use your experience with physiological or clinical recordings to create research-level problems that test and train AI models. The work draws on measurements you have collected and analyzed, rather than clinical practice without data analysis or machine learning based only on public datasets. Experts work remotely as independent contractors, choose how many tasks to accept, and complete standard background and identity verification.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • python
  • matlab
  • r
Science & ResearchView job

Turing

Data Scientist/Analyst

Analyze data and write Python code to enhance AI model performance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • data analysis
  • data science
Data Science & AnalyticsView job

Energy · via Mercor

Enterprise Sales Manager – AI Training Specialist

Apply your frontline sales leadership judgment to realistic B2B scenarios that train and evaluate AI models for enterprise sales teams. You will assess deal health, pipeline quality, forecasts, and Account Executive performance, then write coaching guidance grounded in your experience. The project does not involve managing employees, carrying a quota, or working with customers.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$100–$125/hr
  • enterprise sales
  • b2b sales
  • sales management
Sales & Business DevelopmentView job

Turing · via Braintrust

Staff Research Engineer - Frontier AI and Reinforcement Learning - US and Canada

Advance frontier AI research across synthetic and agentic data, reinforcement learning, post-training, model understanding, benchmarks, and evaluation. You will investigate research questions, build prototypes, and help move proven findings into scalable AI systems. The remote contract runs for three months, starts immediately, and pays $57 USD per hour. Candidates must be based in the United States or Canada.

Location and eligibility
Remote · Canada, United States
Engagement type
Contract
Compensation
$57/hr
  • python
  • machine learning
  • reinforcement learning
Machine Learning & AIView job

Handshake AI

Engineering Expert

The year-round Handshake AI Fellowship brings engineering specialists into project-based work that helps improve large language models in expert fields. You’ll create subject-specific prompts, assess model responses, and research topics with AI. Work remotely on your own schedule for about 10 to 20 hours each week; project placement depends on availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $75/hr
  • industrial engineering
  • mechanical engineering
  • aerospace engineering
Machine Learning & AIView job

SME Careers

Python (ML-Focused) Team Lead

Review Python code and machine learning work for correctness, sound methodology, reproducibility, and compliance with project rubrics. You will guide trainer and QA workflows, give contributors actionable feedback, and maintain resources such as calibration tasks and style guides. This remote contract has no immediate project; qualified candidates may be contacted when relevant work opens. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $120/hr
  • python
  • machine learning
  • data science
Machine Learning & AIView job

micro1

Veterans Combat and Defense Expert

Work with a customer project focused on military operations, defense strategies, and operational decisions. You will create and assess realistic scenarios, judge AI-generated material against military doctrine and real-world practice, and document findings that inform model evaluation and improvement. The role is remote and engages U.S. military veterans with relevant combat, defense, or operational backgrounds.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$50–$100/hr
  • military operations expertise
  • operational planning
  • tactical decision-making
Machine Learning & AIView job

Ethos

University Professor / Lecturer

Help a leading foundational AI lab train a language model on professional presentations and slide decks. You will create, assess, and refine materials for teaching, course design, conferences, concept explanations, assessments, and seminars. Work remotely on your own schedule, with an ASAP start. Task volume varies, hours are not guaranteed, and most experts work under 10 hours per week; no weekly hours cap applies.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$80/hr
  • powerpoint
  • slide design
  • presentation design
Education & TrainingView job

AfterQuery

Field Ecologist & Wildlife/Fisheries Biologist

Use firsthand experience with population data to create research-level problems that test and train AI models. The work draws on field surveys, tagging and telemetry, or fisheries catch and age data that you have collected and analyzed. This remote, flexible contract has no fixed weekly schedule, and accepted experts complete standard background and identity verification.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • python
  • r
  • ecology
Science & ResearchView job

Turing

Software Engineer – AI Research & Evaluation (US-based)

Create and evaluate datasets to enhance AI-generated coding solutions.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • java
Machine Learning & AIView job

Mercor

Clinical Development & Operations Expert

Work remotely from the United States on AI training for clinical development. You will shape realistic trial scenarios, assess model responses against clinical standards and real-world practice, and help research and engineering teams improve model performance. Cincinnatus LLC employs this full-time role on a W-2 basis, with a 40-hour weekday commitment and placement within a leading AI lab.

Location and eligibility
Remote · United States only
Engagement type
Full-time
Compensation
$70–$100/hr
  • clinical development
  • clinical operations
  • clinical trial design
Health Informatics & Medical RecordsView job

Google DeepMind · via Braintrust

Motion Designer / Creative Technologist

Google DeepMind seeks experienced motion designers and creative technologists for onsite AI training and evaluation projects. You’ll create reference animations and code-driven motion work, then assess model-generated content against professional standards. The role calls for at least five years of studio or agency experience, advanced After Effects skills, and practical coding experience. Candidates who advance complete a 15-minute AI interview, followed by a 45-minute technical interview.

Location and eligibility
On-site · United States only
Engagement type
Contract
Compensation
$30–$52/hr
  • motion design
  • adobe after effects
  • kinetic typography
Design & CreativeView job

Handshake AI

Linguistics Expert (India)

Use your linguistics or computational linguistics expertise on flexible, part-time contract projects supporting AI research. You’ll create realistic linguistic problems, assess AI responses for accuracy and analytical rigor, and write structured feedback. The work is ongoing and project-based, with no fixed schedule or minimum hour requirement, so you can complete assignments alongside your current role.

Location and eligibility
Remote · India only
Engagement type
Part-time
Compensation
$40/hr
  • linguistics
  • computational linguistics
  • morphology
Language & LinguisticsView job

SME Careers

Biologist

Use your biology expertise to assess AI-generated explanations, compare proposed solutions, and write accurate model answers across biological topics. You will check scientific claims against public sources and flag errors in reasoning, methods, or prompt adherence. This contract role has no immediate project; qualified experts may hear about relevant work through the expert network.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $70/hr
  • biology
  • cell biology
  • molecular biology
Science & ResearchView job

micro1

Veterans Legal and Human Rights Expert

A U.S. military veteran with expertise in military law, operational law, or human rights will assess legal and ethical issues in military operations, armed conflict, and security work. You’ll create and review scenarios, judge AI-generated legal analysis, and document findings for AI model evaluation. The work calls for sound knowledge of LOAC, ROE, and international humanitarian law.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$50–$100/hr
  • military law
  • operational law
  • international humanitarian law
LegalView job

Showing 20 active roles of 323. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.