AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Turing · via Braintrust

Gemini Education Data Annotator - AI Training

Review education-focused content and Gemini App conversations to help improve large language models. You’ll research questions, check claims against reliable online sources, assess AI responses, and write clear annotations. This remote contract project is open to U.S. applicants and runs about 16 weeks. It requires full-time availability, though workload may vary and is not guaranteed. Pay is $30 USD per hour.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$30/hr
  • gemini app
  • data annotation
  • data analysis
Data annotationView job

Flash · via Mercor

AI Evaluation Rubric Auditor

Audit complete AI-agent shopping and delivery tasks, including the prompt and grading rubric. You will judge whether each rubric failure was fair by checking the available information, the prompt’s requirements, the treatment of valid answers, and the rubric’s structure. You will also give reviewers specific feedback on prompt and rubric issues.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$60–$85/hr
  • llm evaluation
  • rubric design
  • rubric auditing
AI evaluationView job

Handshake AI

AI Evaluation Specialist

Contribute to short-term AI research projects with leading AI labs by applying your academic knowledge to improve large language models in specific fields and topics. Work remotely with no minimum hour commitment. Handshake provides brief training, and you must pass one assessment before starting. Successful project work may qualify you for future projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$17/hr
  • large language models
  • ai evaluation
  • ai training
Machine Learning & AIView job

SME Careers

Slovak Language Expert

Review AI-generated Slovak and write reference answers that show strong grammar, natural phrasing, and cultural awareness. You will compare model responses, assess meaning and tone, check claims when needed, and explain issues in written English. The work runs remotely on an hourly contractor basis and calls for native or near-native Slovak and C1-level English.

Location and eligibility
Remote · Slovakia only
Engagement type
Contract
Compensation
Up to $20/hr
  • slovak
  • english
  • copyediting
Language & LinguisticsView job

micro1

Visual Content Evaluator

Compare original images with AI-generated versions and document visual errors that can guide improvements to image quality. You will upload images you own, follow project guidelines, and work flexible part-time hours as a contractor. Applicants must live in the United States. Prior AI experience is not required; the application includes a short AI interview and no further assessments.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$21–$45/hr
  • image evaluation
  • visual content
  • imagen editing
Design & CreativeView job

Terac

Accountants: Ongoing Paid Project for QuickBooks Workflows

Contribute to a paid, ongoing project that assesses how accounting professionals use QuickBooks for bookkeeping and financial reporting. You will work remotely for 30 to 40 hours each week, handle accounting tasks in the software, and report on workflow efficiency, bottlenecks, and possible improvements. The project welcomes professionals with experience in small business or enterprise accounting.

Location and eligibility
Remote · India, United Kingdom, United States
Engagement type
Contract
Compensation
Pay not listed
  • accounting
  • bookkeeping
  • quickbooks
Finance & AccountingView job

Ethos

Operations Manager / Capacity & Process Improvement

Use your operations expertise to help train a foundational AI model on professional documents, spreadsheets, and slide decks. You will create, assess, and refine materials for capacity planning, inventory forecasting, process mapping, standard operating procedures, business cases, and operational readiness.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • operations management
  • capacity planning
  • inventory forecasting
Operations & ManagementView job

Turing

Data Scientist/Analyst

Analyze data and write Python code to enhance AI model performance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • data analysis
  • data science
Data Science & AnalyticsView job

AfterQuery

Clinical & Biomedical Measurement Scientist

Use your experience with physiological or clinical recordings to create research-level problems that test and train AI models. The work draws on measurements you have collected and analyzed, rather than clinical practice without data analysis or machine learning based only on public datasets. Experts work remotely as independent contractors, choose how many tasks to accept, and complete standard background and identity verification.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • python
  • matlab
  • r
Science & ResearchView job

Meridial by Invisible

Side by Side Factuality Evaluator

Review AI-generated answers across a wide range of subjects, separate them into checkable claims, and compare each claim with credible sources. You’ll judge whether the wording is accurate, inaccurate, or unverifiable, then document your reasoning and supporting evidence under detailed project guidelines. The work calls for fluent English and careful research, including on topics you may not know in advance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$6/hr
  • factuality evaluation
  • claim verification
  • web research
AI evaluationView job

Google DeepMind · via Braintrust

Trade Surveillance & Markets Compliance Expert

Bring hands-on capital markets compliance expertise to the evaluation of AI systems that detect suspicious trading and potential market abuse. You’ll review AI-generated alerts and investigations, assess trading patterns and electronic communications, and provide structured feedback on the accuracy of investigative findings and surveillance logic. Applicants must be based in the United States and have at least four years of relevant professional experience.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$145/hr
  • trade surveillance
  • markets compliance
  • electronic trading
Market Research & InsightsView job

Energy · via Mercor

Enterprise Sales Manager – AI Training Specialist

Apply your frontline sales leadership judgment to realistic B2B scenarios that train and evaluate AI models for enterprise sales teams. You will assess deal health, pipeline quality, forecasts, and Account Executive performance, then write coaching guidance grounded in your experience. The project does not involve managing employees, carrying a quota, or working with customers.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$100–$125/hr
  • enterprise sales
  • b2b sales
  • sales management
Sales & Business DevelopmentView job

Handshake AI

Engineering Expert

The year-round Handshake AI Fellowship brings engineering specialists into project-based work that helps improve large language models in expert fields. You’ll create subject-specific prompts, assess model responses, and research topics with AI. Work remotely on your own schedule for about 10 to 20 hours each week; project placement depends on availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $75/hr
  • industrial engineering
  • mechanical engineering
  • aerospace engineering
Machine Learning & AIView job

SME Careers

Bulgarian Team Lead

Lead quality review for Bulgarian AI training projects by checking generated content and trainer/QA work against project rubrics. You will give written feedback, coordinate contributor updates through Discord, and maintain Bulgarian style guides and quality records in Google Docs and Google Sheets. The selection process includes an AI interview, a domain-specific task, and a recruiter interview.

Location and eligibility
Remote · Bulgaria only
Engagement type
Contract
Compensation
Up to $25/hr
  • bulgarian
  • english
  • bulgarian grammar
Language & LinguisticsView job

micro1

Veterans Intelligence Expert

Review AI-generated military intelligence content for sound analysis, credible scenarios, and defensible operational reasoning. You’ll assess threat assessments and planning, spot unsupported conclusions, and document feedback on how models handle uncertainty and conflicting information. The work draws on military intelligence expertise to evaluate AI systems.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$50–$100/hr
  • military intelligence analysis
  • threat assessment
  • operational planning
Machine Learning & AIView job

Terac

Offensive Cybersecurity Engineers: Build RL Environments for AI Evaluation

Build and strengthen reinforcement learning environments that put frontier AI models through offensive security scenarios. You will create benchmarks and evaluation criteria, then harden those environments against advanced AI interactions. The project runs long term on an hourly, remote basis and focuses on AI evaluation and security risks. Applicants must be based in the USA, Canada, Great Britain, Israel, India, Australia, or New Zealand.

Location and eligibility
Remote · Eligible in 7 countries
Engagement type
Contract
Compensation
Pay not listed
  • offensive cybersecurity
  • penetration testing
  • reinforcement learning
CybersecurityView job

Ethos

Strategy Consultant

Help a leading foundational AI lab train its latest language model on professional presentation work. You will create, assess, and refine AI-generated presentations and slide decks across strategy consulting workflows. Work remotely on your own schedule; client task volume determines available hours, and most experts work under 10 hours a week. The role has no weekly hours cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$80/hr
  • strategy consulting
  • powerpoint
  • storylining
Business Analysis & StrategyView job

Turing

Software Engineer – AI Research & Evaluation (US-based)

Create and evaluate datasets to enhance AI-generated coding solutions.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • java
Machine Learning & AIView job

AfterQuery

Field Ecologist & Wildlife/Fisheries Biologist

Use firsthand experience with population data to create research-level problems that test and train AI models. The work draws on field surveys, tagging and telemetry, or fisheries catch and age data that you have collected and analyzed. This remote, flexible contract has no fixed weekly schedule, and accepted experts complete standard background and identity verification.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • python
  • r
  • ecology
Science & ResearchView job

Meridial by Invisible

Audio Evaluations: JSON & Coding Expert (Dutch, Netherlands)

Review AI-generated coding and technical customer service content, including virtual agent replies, JSON, and audio-related material. You will check accuracy, clarity, and usefulness against project guidelines. The role requires native-level Dutch as used in the Netherlands, but you do not need to live there. You will complete a language introduction and a JSON skills assessment, then submit your own work without LLMs, automation, or scripts.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$11/hr
  • dutch
  • json
  • coding
Language & LinguisticsView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.