AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Ethos

Contracts Attorney / Legal Diligence & Redlines

Help train a foundational AI lab’s language model by creating, assessing, and refining professional legal and business materials. You’ll work on commercial contract redlines, diligence analyses, and related documents, spreadsheets, and slide decks. Work remotely on your own schedule, with an ASAP start. Client task volume varies; most experts work under 10 hours per week, and no weekly cap applies.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$100/hr
  • commercial contracts
  • contract redlining
  • contract negotiation
LegalView job

AfterQuery

Nuclear Science & Engineering Expert (AI Safety)

Use your nuclear science or engineering expertise to assess how AI models handle safety-sensitive requests. You’ll create evaluation prompts, review work from other experts, and explain the technical basis for each safe-or-unsafe judgment. Applicants need an advanced degree, citizenship in a Five Eyes country, and physical presence in one of those countries while working.

Location and eligibility
Remote · Eligible in 5 countries
Engagement type
Not specified
Compensation
$150/hr
  • nuclear science
  • nuclear engineering
  • nuclear safety
CybersecurityView job

Turing

Mathematics Expert (Master’s/Ph.D.)

Design and solve advanced math problems to evaluate language models.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • mathematics
  • algebra
  • calculus
Machine Learning & AIView job

General Translation · via Mercor

German Linguistic Expert

Assess German-language output from a large language model and prepare linguistic data that supports model training. You’ll review text for tasks such as translation, summaries, dialogue, and grammar correction, then flag language issues and share findings with AI researchers. The work calls for strong German language judgment and professional English fluency.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • german
  • english
  • linguistic annotation
Language & LinguisticsView job

Outlier · via Braintrust

Quantitative Finance AI Research Evaluator

Evaluate and help improve AI models’ handling of financial and quantitative reasoning. You’ll assess model-generated content, develop and answer specialist questions, and compare domain-specific responses. The remote contract runs through the end of June, with a possible extension. Applicants must be based in the United States, Canada, Puerto Rico, Mexico, the United Kingdom, Australia, New Zealand, or Argentina.

Location and eligibility
Remote · Eligible in 8 countries
Engagement type
Contract
Compensation
$50–$150/hr
  • quantitative finance
  • financial engineering
  • financial mathematics
Machine Learning & AIView job

Handshake AI

Category Manager

Use your retail category management experience to help improve AI research. You’ll write training questions and scenarios grounded in real workflows, assess AI responses, and give structured feedback. The ongoing, project-based work focuses on pricing strategy, markdown planning, and competitive analysis, with no fixed schedule or minimum hour requirement.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail category management
  • buying
  • pricing strategy
Product ManagementView job

SME Careers

R Engineer

Review AI-generated answers to R and data analysis questions, checking statistical reasoning, code, and results against each prompt. You will also write model solutions and explanations that show sound analytical practice. The role requires at least two years of R experience and C1 English proficiency. No project is active now; qualified experts may be contacted when matching work becomes available.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $55/hr
  • r
  • data analysis
  • data cleaning
Data Science & AnalyticsView job

micro1

Independent Professional & Solopreneur (Domain Expert)

Independent professionals and solopreneurs will apply their domain knowledge to assess real-world work and improve AI training materials. The project focuses on how AI handles practical tasks, including proposals, reports, client communications, and analyses. Prior AI experience is not needed. The role is remote and open to people in the US and Canada.

Location and eligibility
Remote · Canada, United States
Engagement type
Contract
Compensation
$40–$120/hr
  • domain-expertise
  • client-relationship-management
  • written-communication
Machine Learning & AIView job

Ethos

Software / AI / IT & Data Generalist

Help a leading foundational AI lab train its language model by creating, reviewing, and refining professional documents, spreadsheets, and slide decks. Work remotely on your own schedule, with hours tied to client task volume and not guaranteed. Most experts work under 10 hours per week, with no weekly cap on hours or earnings. The start date is ASAP.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$80/hr
  • software engineering
  • data engineering
  • artificial intelligence
Technical Writing & DocumentationView job

AfterQuery

Energy Expert

Use your energy-sector experience to help test and train AI models on realistic work from utilities, oil and gas, and power production. You’ll build practical scenarios, examine operational data, and spot errors in AI responses that require professional judgment. The project is remote and part time, with flexible hours and hourly pay.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • energy analysis
  • utility operations
  • oil and gas
Energy & Power GenerationView job

Turing

Growth Equity Analyst

Evaluate AI models for growth equity insights and investment strategies.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
100 per hour (currency not stated)
  • growth equity
  • company valuation
  • unit economics
Machine Learning & AIView job

General Translation · via Mercor

Canadian English Linguistic Expert

Assess how well a large language model handles Canadian English across translation, summaries, dialogue, and grammar correction. You’ll also edit and annotate language data, flag cultural or linguistic mismatches, and share analysis with AI researchers working on model training. The project calls for strong knowledge of Canadian English, including how its usage differs from American and British English.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • canadian english
  • llm evaluation
  • linguistic annotation
Language & LinguisticsView job

Outlier · via Braintrust

STEM PhD Expert for AI Reasoning & Evaluation

Use your doctoral expertise to assess how AI models handle technical questions and domain-specific content. You’ll check factual accuracy and relevance, compare model responses, and contribute questions and answers in machine learning and AI. The remote contract runs through the end of June, with a possible extension based on project needs. Applicants must live in the United States, Canada, Puerto Rico, Mexico, the United Kingdom, Australia, New Zealand, or Argentina.

Location and eligibility
Remote · Eligible in 8 countries
Engagement type
Contract
Compensation
$50–$150/hr
  • machine learning
  • artificial intelligence
  • computer science
Machine Learning & AIView job

Handshake AI

Human Resources Professional

Use your human resources experience to help shape AI research through work on business communication, strategy, and corporate storytelling. Projects may ask you to create domain-specific prompts or assess LLM responses, drawing on expertise in materials such as board presentations, business cases, investor presentations, client proposals, and executive communications. Work remotely on a flexible schedule with no minimum hour commitment; project placement depends on availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $75/hr
  • human resources
  • business communication
  • business strategy
Human ResourcesView job

SME Careers

Arabic Language Expert

Review Arabic and English AI responses or create bilingual training examples, with a focus on reasoning, accuracy, and clear explanations. You will check claims, spot flawed methods, and compare candidate answers using task rubrics. The work is remote and contract-based; there is no immediate project, but qualified experts may hear about relevant work through the network.

Location and eligibility
Remote · Egypt, Saudi Arabia, South Africa
Engagement type
Contract
Compensation
Up to $15/hr
  • arabic
  • english
  • modern standard arabic
Language & LinguisticsView job

micro1

Heart Failure & Transplant Cardiologist

Use your cardiology expertise to review AI-generated information about heart failure, complex cardiovascular conditions, and advanced treatment options. You will assess clinical reasoning and offer evidence-based feedback on medical recommendations. The role calls for an MD, DO, or equivalent degree, cardiology board certification or specialist qualification, and active or recent practice in heart failure or advanced cardiovascular medicine.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$80–$285/hr
  • heart failure management
  • cardiology
  • advanced cardiovascular therapies
Healthcare & MedicalView job

Ethos

Investment Banking Analyst / Associate

Help a leading foundational AI lab train its language model on professional presentations and slide decks. You’ll create, assess, and refine materials across core investment banking workflows. The role is remote, with flexible scheduling; task volume determines available hours, and most experts work under 10 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100/hr
  • investment banking
  • powerpoint
  • pitch books
Business Analysis & StrategyView job

AfterQuery

Explosives & Energetic Materials Engineer (AI Safety)

Apply your expertise in explosives or energetic materials to assess how AI models handle safety-sensitive questions. You will create and review prompts that test the line between acceptable and unsafe requests, then document the technical basis for each decision. Applicants must hold a relevant master's degree or higher, be citizens of a Five Eyes country, and live in one of those countries while doing the work.

Location and eligibility
Remote · Eligible in 5 countries
Engagement type
Not specified
Compensation
$150/hr
  • explosives
  • energetic materials
  • chemical engineering
CybersecurityView job

Turing

Biology Expert (PhD/Master’s)

Design and solve complex Biology problems to enhance AI language models.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • biology
  • molecular biology
  • cell biology
Science & ResearchView job

General Translation · via Mercor

Australian English Linguistic Expert

Assess how well a large language model handles Australian English, then help improve its language data and outputs. You’ll review text for translation, summarization, dialogue, and grammar correction; refine content for Australian usage; and share linguistic analysis with AI researchers. The work calls for deep knowledge of Australian English and professional experience in language or NLP data work.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • australian english
  • linguistic annotation
  • translation
Language & LinguisticsView job

Showing 20 active roles of 323. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.