AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

AfterQuery

Forensic Accountanting Expert

Create and assess forensic accounting challenges that help train AI models on fraud investigations and litigation support. You will build scenarios around investigative methods, financial analysis, and evidence, then judge model answers against professional standards. A degree in accounting, finance, or a related field and experience in forensic accounting, fraud examination, or litigation support are required.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$113/hr
  • forensic accounting
  • fraud examination
  • litigation support
Finance & AccountingView job

Mercor

Lawyer Talent Network

Join a network that connects legal experts with future AI projects. After you complete your profile and pass an AI interview, Mercor may match you with work based on your background and project needs. Projects cover AI training and evaluation in law, with typical commitments of 15–30 hours per week; scope and duration vary.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$150/hr
  • legal research
  • legal writing
  • contract drafting
Machine Learning & AIView job

Handshake AI

Senior Software Engineer - AI Data (CA)

Review coding agents on real engineering tickets, run their code, and assess the results as you would a teammate’s pull request. You’ll also work through a problem in a codebase you know, noting where the model falters. The contract provides 40 hours of work each week, with flexible scheduling, and requires at least four years of professional software engineering experience.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$120/hr
  • software engineering
  • code review
  • coding agents
Software EngineeringView job

SME Careers

Odia (Oriya) Team Lead

Lead quality review across Odia AI training projects by checking contributor work and model-generated text against project rubrics. You will guide trainers and reviewers on grammar, meaning, tone, and cultural fit, while maintaining Odia style guides and project records in tools such as Discord and Google Sheets. The role requires professional Odia language experience and clear written communication in English.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • odia
  • english
  • localization qa
Language & LinguisticsView job

micro1

Intelligence Operations & Collection Expert

Contribute intelligence expertise to an AI training and evaluation project centered on intelligence operations and national security. You will judge AI-generated scenarios and related materials for accuracy, realism, and operational relevance. The project especially seeks people with experience at civilian intelligence agencies such as the CIA, NSA, MI6/SIS, GCHQ, or equivalent organizations.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$80–$170/hr
  • intelligence operations
  • intelligence collection
  • humint
Machine Learning & AIView job

AfterQuery

EMT Expert

AfterQuery seeks experienced EMTs to create and assess prehospital scenarios for AI model evaluations. You will write cases from dispatch through handoff, explain the field reasoning behind protocol choices, and judge model responses for clinical accuracy and scene safety. The role is remote and asynchronous, with ongoing contractor work and a minimum commitment of 10 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$53/hr
  • nremt certification
  • emt license
  • patient assessment
Health Informatics & Medical RecordsView job

Mercor

GPU Kernel Expert

Review GPU and accelerator kernel-development tasks that support training and evaluation of a frontier AI lab’s models. Judge numerical correctness, benchmark fairness, task scope, and compilation and runtime validity across varied kernel work. You’ll also write rubric-based feedback that explains your findings.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$90/hr
  • cuda
  • triton
  • nki
Machine Learning & AIView job

Handshake AI

Logistics Manager

Use your retail logistics or transportation experience to assess AI-generated material and help models reflect real freight and supply chain workflows. You’ll write training questions and scenarios, review model responses, and submit structured feedback. The work runs on an ongoing, project-based basis, with hourly contract tasks you can complete at your own pace and no set schedule or minimum hours.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail logistics
  • transportation management
  • freight management
Operations & ManagementView job

SME Careers

Croatian Team Lead

Lead quality checks for Croatian-language AI training work by reviewing generated content and contributor submissions against project rubrics. You’ll coach trainers and QA reviewers, resolve language questions, and maintain resources such as style guides, FAQs, and trackers. The role calls for native or near-native Croatian, strong English, and at least three years of relevant language or quality experience.

Location and eligibility
Remote · Croatia only
Engagement type
Contract
Compensation
Up to $30/hr
  • croatian
  • english
  • croatian grammar
Language & LinguisticsView job

micro1

Senior Intelligence Analyst – National Security

Contribute senior intelligence expertise to an AI training and evaluation project covering national security, intelligence analysis, and government decision-making. You will assess AI-generated reports and scenarios for accuracy, realism, and analytical quality, drawing on skills in intelligence analysis, threat assessment, source evaluation, and critical thinking.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$80–$170/hr
  • intelligence analysis
  • threat assessment
  • analytical reasoning
Data Science & AnalyticsView job

Turing

Domain Expert- Music

Evaluate and improve AI responses in music theory and genres.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • music theory
  • musicology
  • ethnomusicology
Machine Learning & AIView job

AfterQuery

Notary Public Expert

AfterQuery seeks commissioned notaries to create notarization and document execution scenarios for AI model evaluations. You will write answers grounded in statutory reasoning and assess model responses against state notary law. The work is remote and asynchronous, with a minimum commitment of 10 hours per week as an independent contractor.

Location and eligibility
Remote · United States only
Engagement type
Not specified
Compensation
$48/hr
  • notary public
  • notarial practice
  • acknowledgments
AI evaluationView job

Mercor

Physician Talent Network

Join Mercor’s physician network for potential contract projects with AI labs and companies. After you complete a profile and pass an AI interview, Mercor may match you with projects as they become available. Work can include medical model training and evaluation, with commitments that typically range from 15 to 30 hours per week. Project scope and duration vary.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$110–$250/hr
  • clinical diagnosis
  • medical treatment
  • patient care management
Machine Learning & AIView job

Handshake AI

REC Trader

Use your renewable energy experience on remote, hourly contract projects that help AI research teams assess and improve model responses. You’ll create expert training data and review AI answers about renewable generation, REC trading, and portfolio management. The schedule is flexible, with no minimum hours; contributors often work 5–20 hours per week during active projects. Project placement depends on current needs, with future projects possible.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • renewable energy generation
  • rec trading
  • renewable portfolio management
Energy & Power GenerationView job

SME Careers

Explosives & Energetic Materials Expert for AI Safety Audit

Review three AI-generated answers to realistic explosives and energetic-materials questions. You will classify each request, assess safety and technical accuracy, rank the responses, and draft a suitable answer. For dual-use requests, explain the legitimate context and access considerations. The role draws on professional explosives or hazardous-materials expertise, with eligibility limited to citizens or permanent residents of the US, UK, Canada, Australia, New Zealand, or the European Union.

Location and eligibility
Remote · Eligible in 32 countries
Engagement type
Full-time
Compensation
$1–$100/hr
  • explosives safety
  • energetic materials
  • hazard classification
CybersecurityView job

micro1

AI Jailbreak & Prompt-Injection Security Expert

Work on an AI safety initiative by testing models for ethical jailbreaks, prompt injection, and tool-use abuse. You’ll develop adversarial evaluation methods, probe multi-turn weaknesses, maintain regression tests, and share findings with technical and non-technical audiences. AI experience is not required; relevant domain knowledge matters.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$50–$90/hr
  • Ethical Jailbreaks
  • LLM Red Teaming
  • Prompt Injection
Machine Learning & AIView job

Turing

Real Estate Concierge Specialist

Apply your background in property management, real estate operations, or community administration to projects that test and improve AI. You will create property and concierge scenarios, write structured solutions, and assess AI responses. No AI experience is needed. The work is fully remote, with freelance projects expected to last about one month and possible extensions.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • property management
  • community management
  • real estate operations
Sales Engineering & Solutions ConsultingView job

AfterQuery

Paralegal Expert

Create and assess legal scenarios that test how AI models handle paralegal work, from legal research and citation formats to document drafting, discovery, and case management. You will judge model answers against paralegal best practices and legal standards, then work with legal and technical specialists to shape content that teaches practical, real-world skills.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$55/hr
  • paralegal studies
  • legal research
  • document preparation
LegalView job

Mercor

SWE-Bench Task Auditor

Review repository-level software engineering benchmarks used to train and evaluate a frontier AI lab’s models. You’ll examine task quality, reference patches, test harnesses, Docker isolation, and grading integrity, then write clear feedback against a rubric. The role calls for professional software engineering experience and open-source contribution or maintainer work. The listing is limited to the United States.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$90/hr
  • python
  • java
  • go
Quality Assurance & TestingView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.