AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Turing

Personal Account Generalist Raters (Android Smartphone Users)

Review AI-generated responses for accuracy and personalization using mobile data.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$25/hr
  • ai evaluation
  • response rating
  • personalization
AI evaluationView job

AfterQuery

Tax Attorney Expert

Create tax-law scenarios and reference analyses that help AI labs assess model judgment. You’ll work in your tax specialty, drawing on the Code, regulations, and relevant authority to write examples and evaluate model answers. The contract is fully remote and asynchronous, with no fixed hours; commit at least 10 hours each week and adjust your workload from week to week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$160/hr
  • tax law
  • tax code
  • tax regulations
LegalView job

Mercor

Certified Pharmacy Technician (CPhT)

A leading AI research lab needs experienced pharmacy technicians to help shape AI-powered prior authorization workflows. You will answer medication questions using patient context and source materials, then assess AI responses for accuracy, safety, clarity, and evidence. The project requires 30–40 hours of work per week and focuses on medication management, pharmacy operations, and clear clinical annotations.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$35/hr
  • pharmacy operations
  • medication management
  • prior authorization
Health Informatics & Medical RecordsView job

Handshake AI

FP&A Analyst

Use your retail finance or FP&A experience on flexible, part-time project work that supports AI research. You’ll build training scenarios from real planning workflows, assess AI-generated answers, and write feedback on their accuracy and relevance. Work at your own pace, with no set schedule or minimum hour requirement, alongside your current work.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • fp&a
  • retail finance
  • financial planning
Finance & AccountingView job

SME Careers

Biology Quality Assurance Lead (QAL)

Lead quality checks for biology AI training work by reviewing scientific content and contributor output against project rubrics. You will give trainers and QAs specific feedback, keep guidance and calibration materials current, and flag scientific or biosafety risks. The role requires substantial biology knowledge, clear English communication, and experience with quality-focused workflows.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $75/hr
  • biology
  • molecular biology
  • cell biology
Quality Assurance & TestingView job

Turing

Domain Expert - TV Show & Movies

Evaluate and improve AI responses about film and television accuracy.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • film studies
  • television studies
  • entertainment journalism
AI evaluationView job

AfterQuery

Linguistics Expert

AfterQuery’s expert data lab creates evaluation and training data for frontier AI labs. As a contract linguist, you’ll write scenarios that probe model reasoning in areas such as syntax, semantics, and phonology, then assess the accuracy of model analyses. The work runs remotely on an async schedule, with at least 10 hours of work each week and no set maximum.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • linguistics
  • syntax
  • semantics
Language & LinguisticsView job

Mercor

Private Equity & Venture Capital - Finance Domain Expert

Bring senior finance judgment to work that tests how frontier AI models handle real financial problems. You will assess finance tasks and model answers, write task instructions and reference solutions, and build evaluation sets with research teams. Cincinnatus LLC employs this full-time W-2 role, which places you with a client team in the Bay Area. Expect 40 hours per week for an initial six-month engagement and on-site work several days each week when required.

Location and eligibility
Hybrid · United States only
Engagement type
Full-time
Compensation
$110–$150/hr
  • private equity
  • venture capital
  • corporate finance
Finance & AccountingView job

Handshake AI

Land Administrator

Bring your upstream land or accounting experience to project-based AI research. You’ll write training questions and scenarios, assess model responses against real land administration and mineral title practices, and give structured feedback. Work at your own pace alongside your current commitments, with no set schedule or minimum hours.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $80/hr
  • land administration
  • mineral title
  • upstream accounting
Machine Learning & AIView job

SME Careers

Political Science Quality Assurance Lead (QAL)

Guide quality across political science AI training projects by reviewing generated content and contributor work against project rubrics. You will assess accuracy, comparative context, policy reasoning, and ideological balance, then coach trainers and QAs through feedback, onboarding, and project documentation. The role uses Discord, Google Docs, and Google Sheets. No project is active now; qualified candidates may be contacted as relevant work opens.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $70/hr
  • political science
  • comparative politics
  • international relations
Quality Assurance & TestingView job

AfterQuery

Producer and Director Expert

Create and assess media production challenges that help train AI models to apply film, television, and theater principles. You will build scenarios around creative decisions, storytelling, and project management, then review model answers against production practices and industry standards. The role calls for production leadership experience and strong communication and analytical skills.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • media production
  • film production
  • television production
Machine Learning & AIView job

Mercor

Indonesian Linguistic Experts

Assess how well a large language model handles Indonesian across translation, summaries, dialogue, and grammar correction. You’ll refine and annotate Indonesian text, flag language gaps, and share detailed findings with AI researchers. Your work will support model training and improve its understanding and generation of Indonesian, with attention to grammar, cultural standards, and context.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$30/hr
  • indonesian
  • linguistic annotation
  • translation
Language & LinguisticsView job

Handshake AI

Production Engineer

Use at least two years of experience in reservoir engineering, subsurface analysis, or production operations to create expert training data and assess AI responses. You’ll share feedback on accuracy, relevance, and subsurface workflows. The remote, project-based work has a flexible schedule with no minimum hours; contributors often work 5–20 hours per week during active projects. No AI background is required, and placement depends on project needs.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • reservoir engineering
  • subsurface analysis
  • production operations
Machine Learning & AIView job

SME Careers

SQL Team Lead

Lead quality checks for SQL and database content used in AI training projects. You will review generated queries and explanations, assess contributor work against project rubrics, and guide trainers and QAs through feedback, documentation, and onboarding. This is a remote contract role with no immediate project; qualified candidates may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $70/hr
  • sql
  • mysql
  • postgresql
Data EngineeringView job

AfterQuery

Insurance Policy Analyst

Review insurance policy language and assess coverage, forms, endorsements, exclusions, and regulatory compliance through asynchronous, project-based work. Projects run over the next 2 to 3 weeks and call for 10 to 20 hours per week on assignments you accept. You will also document your reasoning and technical judgments so others can follow them.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • insurance policy analysis
  • coverage analysis
  • policy interpretation
Business Analysis & StrategyView job

Mercor

Japanese Linguistic Experts

Assess how well a large language model handles Japanese tasks such as translation, summaries, dialogue, and grammar correction. You will also refine Japanese text, annotate linguistic features, and give researchers detailed feedback that supports model training. The project pairs language expertise with AI research at a leading research lab.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • japanese
  • translation
  • editing
Language & LinguisticsView job

Handshake AI

Marketing Manager

Use your retail marketing or CRM experience to create expert training data and assess AI-generated responses for accuracy and relevance. The ongoing, project-based work centers on promotional planning, customer nurture emails, and competitive monitoring. You can work remotely on a flexible schedule, with no minimum hours; contributors typically spend 5–20 hours per week during active projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail marketing
  • customer relationship management
  • promotional campaign planning
Marketing & Brand ManagementView job

SME Careers

Kotlin Team Lead

As a remote contract Kotlin Quality Assurance Lead, you will assess AI-generated Kotlin code and contributor reviews against project rubrics. You will focus on Kotlin, coroutines, and Android/JVM context, then share specific feedback and maintain materials that help contributors meet quality standards. No project starts immediately; qualified candidates may hear about relevant work as opportunities arise.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $65/hr
  • kotlin
  • android
  • jvm
Quality Assurance & TestingView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.