AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Handshake AI

Domain Expert, AI Evaluation (US)

Use your STEM expertise to help improve large language models across scientific and technical fields. Project work may involve creating and solving challenging problems, writing domain-specific prompts, and judging model answers for accuracy and reasoning quality. The year-round fellowship offers remote, asynchronous project work for about 5 to 20 hours per week; assignments depend on project availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$200/hr
  • mathematics
  • chemistry
  • biology
Machine Learning & AIView job

SME Careers

Japanese Team Lead

Lead Japanese quality reviews across AI training projects, checking model outputs and contributor work against project rubrics. You’ll give specific feedback, answer language questions, coordinate updates through Discord, and maintain resources such as Japanese style guides and QA trackers. This is a remote contract role with no immediate project; qualified candidates may be contacted when relevant work becomes available.

Location and eligibility
Remote · Eligible in 7 countries
Engagement type
Contract
Compensation
Up to $55/hr
  • japanese
  • english
  • japanese quality assurance
Language & LinguisticsView job

micro1

Personal Injury Lawyer

Review legal scenarios and AI-generated legal work for a project aimed at improving legal reasoning and accuracy in AI systems. You will assess liability, spot gaps or errors, and give structured corrections grounded in your legal expertise. Applicants must hold a J.D. from a U.S. law school, maintain an active license in at least one U.S. state, and live in the United States.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$170/hr
  • legal reasoning
  • issue-spotting
  • document review
LegalView job

Google DeepMind · via Braintrust

Brand & Advertising Art Director

Create brand identity references and advertising assets, then assess visual designs generated by AI models for training and evaluation projects. The work draws on studio or agency art direction, with a focus on consistent brand systems, multi-format campaigns, and clear design standards. Shortlisted candidates complete a 15-minute AI interview, followed by a 45-minute technical interview with the team.

Location and eligibility
On-site · United States only
Engagement type
Contract
Compensation
$30–$52/hr
  • brand identity
  • art direction
  • advertising design
Design & CreativeView job

AfterQuery

Explosives & Energetic Materials Engineer (AI Safety)

AfterQuery needs explosives and energetic materials specialists to create and assess AI safety evaluation tasks. You will judge whether prompts cross a safety boundary and explain the technical basis for each decision. The work is remote, flexible, and task-based. The listing sets pay at $85 per approved task, equivalent to $150 per hour.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$150/hr
  • chemical engineering
  • chemistry
  • mechanical engineering
EngineeringView job

General Translation · via Mercor

German Linguistic Expert

Assess German-language output from a large language model and prepare linguistic data that helps improve its understanding and generation. You’ll review tasks such as translation, summarization, dialogue, and grammar correction, then share your findings with AI researchers on a project with a leading research lab.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • german
  • english
  • translation
Language & LinguisticsView job

Terac

Government and Public Policy Professionals: AI Training Tasks

Use your public-sector expertise to create and assess tasks that help train AI models on real government workflows. You will write, review, and grade policy prompts covering public procurement, budget planning, fiscal analysis, and program evaluation through a desktop platform. The project is remote and requires at least 20 hours per week through December.

Location and eligibility
Remote · Eligible in 14 countries
Engagement type
Contract
Compensation
Pay not listed
  • ai training
  • government administration
  • public policy
Machine Learning & AIView job

Ethos

Expert Call: AI Model Post-Training Landscape

Take part in a paid, video-based research interview of about 45 minutes on how organizations select post-training platforms and services. Discuss your use case, provider choices, evaluation process, data and evaluation work, costs, results, and business value. Interviews can be scheduled at your convenience, and the client will not request confidential code or proprietary data.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
Pay not listed
  • ai model post-training
  • supervised fine-tuning
  • reinforcement learning fine-tuning
Machine Learning & AIView job

Turing

DataGen & Evals

Review Japanese patient histories and evaluate AI-generated clinical plans.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • japanese
  • english
  • internal medicine
AI evaluationView job

Meridial by Invisible

Dutch speakers specialist

As an independent contractor on an audio and language model evaluation project, you’ll assess Dutch samples for accuracy, fluency, naturalness, and overall quality. Your reviews may require close attention to grammar, pronunciation, tone, phrasing, and word choice, including whether spoken Dutch fits its context. Each task takes about 30 seconds to 4 minutes.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$1.3 fixed
  • dutch
  • dutch grammar
  • dutch spelling
Language & LinguisticsView job

Handshake AI

Pricing Analyst

Use your retail pricing experience on an ongoing, project-based AI research opportunity. You’ll create training scenarios, assess AI responses against real pricing and markdown practices, and write feedback to guide model improvement. The part-time work is remote and self-scheduled, with no set hours or minimum hour requirement, so you can take it on alongside your current work.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail pricing
  • price management
  • pricing strategy
Data Science & AnalyticsView job

SME Careers

Korean Quality Assurance Lead (QAL)

Guide quality across Korean AI training projects by reviewing model outputs and trainer or QA work against project rubrics. You will give specific feedback, resolve questions about Korean usage, and keep contributor guidance current through Discord and Google Docs. The role is remote and contract-based, with no immediate project; qualified candidates may hear about future assignments through the expert network.

Location and eligibility
Remote · Eligible in 6 countries
Engagement type
Contract
Compensation
Up to $45/hr
  • korean
  • english
  • korean proofreading
Quality Assurance & TestingView job

micro1

Teacher (US/CAN based)

Use your teaching expertise to assess educational materials and help develop training data for AI systems. You’ll review AI-generated lessons, quizzes, rubrics, student feedback, and parent communications, then flag accuracy, age-appropriateness, and teaching-practice concerns. No AI background is needed, but you must work full time in education and have at least two years of hands-on teaching experience.

Location and eligibility
Remote · Canada, United States
Engagement type
Contract
Compensation
$20–$80/hr
  • lesson plan evaluation
  • curriculum design
  • assessment writing
Education & TrainingView job

Google DeepMind · via Braintrust

Motion Designer / Creative Technologist

Google DeepMind seeks experienced motion designers and creative technologists for onsite AI training and evaluation projects. You’ll create reference animations and code-driven motion work, then assess model-generated content against professional standards. The role calls for at least five years of studio or agency experience, advanced After Effects skills, and practical coding experience. Candidates who advance complete a 15-minute AI interview, followed by a 45-minute technical interview.

Location and eligibility
On-site · United States only
Engagement type
Contract
Compensation
$30–$52/hr
  • motion design
  • adobe after effects
  • kinetic typography
Design & CreativeView job

AfterQuery

Radioactive Materials & Health Physics Expert (AI Safety)

Help assess how AI models handle safety questions about radioactive materials and health physics. You’ll create and review evaluation prompts, classify each request, and explain the technical basis for your judgment. The work is remote and task-based; each approved task pays $85, equivalent to $150 per hour. Applicants must provide their highest degree and field, citizenship, and current country of residence.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$150/hr
  • health physics
  • radiochemistry
  • nuclear engineering
AI evaluationView job

Mercor

Rheumatologist

Assess health AI models with a leading AI lab by reviewing de-identified patient charts and judging answers to rheumatology questions. You will compare two responses, assess clinical accuracy and safety against current standards of care, and explain your judgments. The project offers remote, flexible part-time hours at an hourly rate and an immediate start.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$200/hr
  • rheumatology
  • abim rheumatology
  • clinical chart review
Health Informatics & Medical RecordsView job

Terac

Corporate Legal Professionals: Interview on Outside Legal Services

Take part in a paid, 60-minute remote video interview about corporate legal operations and outside legal services. You’ll discuss how you select, onboard, and manage external legal providers, along with your approach to budgets, vendor relationships, and provider performance. Applicants must live in the USA and have hands-on experience managing or working with outside legal services for a corporation.

Location and eligibility
Remote · United States only
Engagement type
Freelance
Compensation
Pay not listed
  • corporate legal operations
  • corporate counsel
  • in-house legal
LegalView job

Ethos

Enterprise AI Platform Expert Interview

Take part in a research study about how organisations with more than 1,000 employees select, purchase, and deploy enterprise AI platforms. If your organisation evaluated, bought, or deployed Glean, Mistral AI, Cohere, Dust, Langdock, Palantir AIP, or Wonderful AI, you may qualify for a 45 to 60 minute video interview. The study pays $350 per completed interview.

Location and eligibility
Remote · United Kingdom only
Engagement type
Part-time
Compensation
$350 fixed
  • enterprise ai platforms
  • glean
  • mistral ai
Enterprise Systems (ERP/CRM)View job

Turing

AI Assistant Raters - US Based

Evaluate AI assistant responses based on user experience and quality.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • ai evaluation
  • response evaluation
  • prompt evaluation
AI evaluationView job

Meridial by Invisible

Audio Evaluations: JSON & Coding Expert (Multiple Languages)

Evaluate AI-generated technical and customer-facing responses, drawing on language fluency, coding knowledge, and customer service judgment. You’ll check response quality and JSON structure against project guidelines. The available language cohorts are Dutch (Netherlands), Welsh, French (Canada), German (Germany), Italian (Italy), Portuguese (Brazil), Greek, English (US), and English (UK).

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$11/hr
  • json
  • coding
  • language fluency
Language & LinguisticsView job

Showing 20 active roles of 770. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.