AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Turing · via Braintrust

Quality & Patient Safety Nurse - AI Evaluation

Use your quality and patient safety nursing expertise to build clinical cases and assess AI responses. You will work remotely as a US-based contractor on a 12-week project, with a target start date of November 2, 2026. Choose 20 or 40 hours per week and plan for four hours of overlap with Pacific working hours. Selection involves an application review and assessment.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$65/hr
  • quality improvement
  • patient safety
  • infection prevention
Quality Assurance & TestingView job

AfterQuery

Process & Chemical Plant Engineer

Use your chemical engineering experience with real plant or pilot data to create research-level problems that test and train AI models. The work centers on data grounded in plant operations, including performance across columns, reactors, membranes and utilities, as well as guarantee testing. You can take on flexible, task-based contract work without a fixed weekly schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • chemical engineering
  • process engineering
  • python
EngineeringView job

Turing

Software Engineer

Create and refine Python code for AI model training and evaluation.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$200/hr
  • python
  • javascript
  • react
Machine Learning & AIView job

Handshake AI

Senior Software Engineer - AI Data (MX)

Review coding agents as they tackle real engineering tickets, then work through problems in codebases you know to pinpoint and correct model mistakes. The contract offers 40 hours of work each week, with flexible scheduling and weekly renewal when your work meets quality standards. The selection process includes a proctored coding assessment and a paid trial task.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60/hr
  • software engineering
  • code review
  • coding agents
Machine Learning & AIView job

SME Careers

Cantonese Quality Assurance Lead (QAL)

Lead quality reviews for Traditional Chinese Hong Kong and Cantonese AI training projects. You will assess generated content and contributor work against project rubrics, give actionable feedback in English, and guide remote trainers and reviewers through Hong Kong-specific language standards. The role is a contract opportunity with no immediate project; qualified experts may be contacted when relevant work becomes available.

Location and eligibility
Remote · Hong Kong only
Engagement type
Contract
Compensation
Up to $40/hr
  • cantonese
  • traditional chinese
  • hong kong chinese
Quality Assurance & TestingView job

Mercor

Software Engineer — Agentic Search Systems

Bring your experience shipping search systems into a 25-minute conversation about search quality, evaluation, and the tradeoffs behind real implementations. The interview has no coding or take-home exercise. Candidates whose interviews stand out may be invited to a paid, 30-minute live conversation with the team; payment follows completion of the call.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Task-based
Compensation
$150 fixed
  • search systems
  • agentic search
  • information retrieval
Sales Engineering & Solutions ConsultingView job

micro1

AI Agent Evaluator

Test two AI agents on your phone by asking them to handle everyday errands, then review what happened from a user’s perspective. Each run takes about 1.5 hours, including recording evidence and scoring results. You’ll need an active personal account with a popular AI service, such as ChatGPT, and a smartphone with screen recording. After presentation to the hiring manager, onboarding typically takes 24–48 hours.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$25–$45/hr
  • ChatGPT
  • Muse
  • AI agents
Quality Assurance & TestingView job

AfterQuery

Advanced Coding Expert

AfterQuery needs experienced software engineers to create realistic, multi-step coding challenges for advanced AI coding agents. You will draw on a substantial private codebase you own, frame problems that require investigation across modules, and create Docker-based environments with tests that assess solutions and catch regressions.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$85/hr
  • javascript
  • typescript
  • java
Software EngineeringView job

Turing

AI Quality Analyst - English

Evaluate AI personalization quality using your personal experiences and insights.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • ai evaluation
  • personalization evaluation
  • prompt engineering
Quality Assurance & TestingView job

Handshake AI

Senior Software Engineer - AI Data (IN)

Use your software engineering experience to assess coding agents on real engineering problems. You’ll give an agent a ticket and review its work, then work through a problem in a codebase you know and mark where the model fails. The contract offers 40 hours of work each week, with flexible scheduling and weekly renewal based on quality standards.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60/hr
  • software engineering
  • code review
  • pull requests
Machine Learning & AIView job

SME Careers

Cultural Studies Quality Assurance Lead (QAL)

Lead quality reviews for art history, visual culture, and cultural studies AI training work. You will assess generated explanations and visual analyses, check trainer and QA work against project rubrics, and flag historical errors, weak context, or biased interpretations. The role also covers contributor onboarding, review guidance, and project records maintained with tools such as Discord, Google Docs, and Google Sheets.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $65/hr
  • art history
  • cultural studies
  • visual analysis
Quality Assurance & TestingView job

Mercor

Audiobook QA Expert — English (US)

Listen to AI-generated audiobooks in US and North American English and assess whether the narration sounds natural, accurate, and enjoyable. You’ll mark speech and audio issues in review tools, identify where the listening experience falters, and rate listener satisfaction. The role calls for native or near-native English fluency, regular audiobook listening, and availability for about 20 hours each week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$20–$25/hr
  • audiobook quality assurance
  • audio annotation
  • speech evaluation
Language & LinguisticsView job

micro1

AI Jailbreak & Prompt-Injection Security Expert

Work on an AI safety initiative by testing models for ethical jailbreaks, prompt injection, and tool-use abuse. You’ll develop adversarial evaluation methods, probe multi-turn weaknesses, maintain regression tests, and share findings with technical and non-technical audiences. AI experience is not required; relevant domain knowledge matters.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$50–$90/hr
  • Ethical Jailbreaks
  • LLM Red Teaming
  • Prompt Injection
Machine Learning & AIView job

AfterQuery

Professional Engineer Expert

AfterQuery engages licensed engineers to create and assess scenarios that test how AI models handle professional engineering decisions. You will build examples spanning design, review, and approval, then explain the code and safety considerations behind sound answers. The work is remote and asynchronous, with a minimum commitment of 10 hours per week.

Location and eligibility
Remote · United States only
Engagement type
Not specified
Compensation
$148/hr
  • professional engineering
  • professional engineer license
  • design review
Sales Engineering & Solutions ConsultingView job

Turing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

Handshake AI

Senior Software Engineer - AI Data (CA)

Review coding agents on real engineering tickets, run their code, and assess the results as you would a teammate’s pull request. You’ll also work through a problem in a codebase you know, noting where the model falters. The contract provides 40 hours of work each week, with flexible scheduling, and requires at least four years of professional software engineering experience.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$120/hr
  • software engineering
  • code review
  • coding agents
Software EngineeringView job

SME Careers

TypeScript Team Lead

Lead quality checks for TypeScript AI training work by reviewing code and contributor output against project rubrics. You’ll coach trainers and QA reviewers, resolve questions about type safety and runtime behavior, and maintain calibration and onboarding materials. This is a contract role with no immediate project assignment; qualified candidates may be contacted when relevant work opens. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $70/hr
  • typescript
  • javascript
  • node.js
Quality Assurance & TestingView job

Mercor

Applied Engineer, Evaluations Role

Build and refine software engineering evaluations from completed pull requests, using Mercor’s in-house framework to assess frontier coding agents such as Claude Code and Codex. You’ll work with an internal research team whose benchmarks compare frontier large language models, then take ownership of evaluation selection, development, and refinement after onboarding.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100–$120/hr
  • typescript
  • javascript
  • python
Machine Learning & AIView job

AfterQuery

Technology and Professional Services Expert

Create and assess consulting challenges for AI training, drawing on experience with technology services and client engagements. You will write questions and case studies about areas such as solution architecture, vendor selection, and technology strategy, then review model answers for accuracy and alignment with professional services standards. The role also involves working with other technology experts to shape content difficulty and learning value.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$80/hr
  • technology consulting
  • professional services
  • systems integration
Sales Engineering & Solutions ConsultingView job

Turing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • react
Machine Learning & AIView job

Showing 20 active roles of 113. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.