AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Handshake AI

Energy Accountant

Use your energy-industry experience to create training material and review AI-generated responses about utility workflows and customer data management. The work draws on knowledge of utility metering, customer operations, and billing systems. Projects run on a remote, flexible schedule with no minimum hours; contributors often work about 5–20 hours per week during active projects. No prior AI experience is needed.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • utility metering
  • customer operations
  • energy billing
Data Science & AnalyticsView job

SME Careers

Latvian Team Lead

Guide quality across Latvian AI training projects by reviewing contributor work and model-generated content against project rubrics. You will give specific feedback, resolve language questions, run onboarding, and maintain resources such as Latvian style guides and quality trackers, using Discord and Google Docs to coordinate with trainers and QA reviewers. No project is active now; qualified candidates may be contacted when a suitable assignment opens.

Location and eligibility
Remote · Latvia only
Engagement type
Contract
Compensation
Up to $25/hr
  • latvian
  • english
  • latvian grammar
Language & LinguisticsView job

micro1

Military Operations & Reporting SME

Use your military operations and DoD reporting knowledge to review reporting content and help train AI systems. You’ll assess accuracy, clarity, terminology, and reporting standards, then give written feedback and shape realistic training examples. Prior AI experience is not needed. The work is remote and supports a customer project.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$40–$80/hr
  • military operations expertise
  • dod reporting standards
  • report writing
Machine Learning & AIView job

Turing

AI Quality Analyst (Personalization) - Russian

Evaluate personalized AI responses in Russian for relevance and grounding.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • russian
  • prompt engineering
  • ai evaluation
AI evaluationView job

AfterQuery

Audit or Assurance Accounting Expert

Create audit questions and case studies that test how AI models handle real audit work, from planning and risk assessment to controls, evidence, and fraud detection. You will assess model answers against GAAS and audit best practices, then help audit and technical specialists shape the difficulty and learning value of each challenge.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$113/hr
  • auditing
  • gaas
  • internal controls
Finance & AccountingView job

Mercor

Audiobook QA Expert — Dutch

Reviewers listen to Dutch (Netherlands) AI-narrated audiobooks and assess whether the speech sounds accurate, natural, and enjoyable. You’ll mark and categorize speech errors, then share where narration holds a listener’s attention or disrupts the experience. The remote, part-time schedule calls for about 20 hours per week, or roughly four hours per day.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$15–$20/hr
  • dutch
  • audiobook quality assurance
  • text-to-speech evaluation
Language & LinguisticsView job

Handshake AI

Data Scientist

Use your data science experience on flexible, project-based AI research work. You’ll create realistic problems grounded in modeling and experimentation, assess AI responses for technical accuracy and practical relevance, then write feedback that helps improve model performance. The work has no fixed schedule or minimum hour requirement and can fit alongside your current role. Applicants must live in the United States.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$120/hr
  • data science
  • machine learning
  • applied machine learning
Data Science & AnalyticsView job

SME Careers

Latvian Language Expert

Review AI-produced Latvian text and write reference answers that demonstrate accurate, natural language use. You will assess grammar, meaning, tone, register, and cultural fit, then explain issues in English and compare model responses. The role uses an hourly remote contractor workflow and calls for native or near-native Latvian plus professional English proficiency.

Location and eligibility
Remote · Latvia only
Engagement type
Contract
Compensation
Up to $20/hr
  • latvian
  • english
  • latvian grammar
Language & LinguisticsView job

micro1

Senior DoD Staff Writing SME

Create realistic Department of Defense staff-writing examples and evaluation materials for an AI training project. You will develop prompts, source artifacts, model answers, and scoring guidance for formats such as WARs, SITREPs, executive summaries, and performance reports, then refine them through project feedback. Applicants must be based in the United States; prior AI experience is not needed.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$40–$80/hr
  • military writing
  • federal documentation standards
  • report generation and evaluation
Technical Writing & DocumentationView job

Turing

Small business owners - English Business Document

Evaluate AI chatbot responses for small business scenarios and provide feedback.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • business analysis
  • small business operations
  • ai chatbot evaluation
AI evaluationView job

AfterQuery

Construction Expert

AfterQuery needs construction professionals with 1 to 3 years of experience for project-based work over the next 2 to 3 weeks. You’ll review construction documents, support planning and field problem-solving, and evaluate technical questions across different project types. Work runs asynchronously, with a 10 to 20 hour weekly commitment for each project you accept.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • construction documents
  • construction drawings
  • construction specifications
Sales Engineering & Solutions ConsultingView job

Mercor

Management Consultant Talent Network

Mercor’s Management Consultant Expert Network connects experienced consultants with AI labs and companies seeking domain expertise. After you complete your profile and pass an AI interview, Mercor may match you with future projects as needs arise. Work can include AI model training and evaluation, scenario-based task creation, and feedback for AI research. Projects typically call for 15–30 hours per week, though scope and duration vary.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$100/hr
  • management consulting
  • strategic analysis
  • problem solving
Machine Learning & AIView job

Handshake AI

Security Engineer

Use your security engineering or offensive security experience to build expert training data and assess AI-generated security content. This remote, part-time contract work is project-based, with a flexible asynchronous schedule and no minimum hours. Contributors often work about 5–20 hours per week during active projects. Placement depends on project needs, with consideration for future projects as they open.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $80/hr
  • security engineering
  • offensive security
  • penetration testing
CybersecurityView job

SME Careers

Gujarati Expert with Mathematical Background

Use your mathematics education and Gujarati expertise to shape AI training content. You will review generated responses, write reference answers, and compare outputs for accuracy, grammar, tone, and cultural fit. The work spans prompts in areas such as education, customer support, general knowledge, and conversational writing, with written feedback in English.

Location and eligibility
Remote · India, United Kingdom, United States
Engagement type
Contract
Compensation
Up to $20/hr
  • gujarati
  • mathematics
  • english
Language & LinguisticsView job

micro1

Federal Staff Reporting Analyst

As a Federal Staff Reporting Analyst, you will create and assess federal and military-style reports used to train AI systems. You will draft examples such as Weekly Action Reports, Situation Reports, after-action summaries, and executive briefings, then help set standards for evaluating those materials. The work is remote and limited to applicants based in the United States. Prior AI experience is not required.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$40–$80/hr
  • military writing
  • federal documentation standards
  • report generation and evaluation
Technical Writing & DocumentationView job

Turing

Financial Trading Specialist

Evaluate and train AI models using trading expertise and market analysis.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
$100/hr
  • trade execution
  • market analysis
  • market microstructure
Machine Learning & AIView job

AfterQuery

Real Estate Broker Expert

Create realistic property transaction scenarios for AI model evaluations, then assess model responses against contractual reasoning and professional obligations. You’ll cover transactions from listing and offers through inspection, financing, and closing. The work runs remotely on an async schedule as an independent contractor, with a commitment of at least 10 hours per week and no fixed maximum.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$100/hr
  • real estate
  • real estate brokerage
  • transaction management
AI evaluationView job

Mercor

Software Engineer — Agentic Search Systems

Bring your experience shipping search systems into a 25-minute conversation about search quality, evaluation, and the tradeoffs behind real implementations. The interview has no coding or take-home exercise. Candidates whose interviews stand out may be invited to a paid, 30-minute live conversation with the team; payment follows completion of the call.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Task-based
Compensation
$150 fixed
  • search systems
  • agentic search
  • information retrieval
Sales Engineering & Solutions ConsultingView job

Handshake AI

Drilling Superintendent

Use your experience in drilling operations, well planning, and energy data systems to create expert training material and assess AI-generated content. You’ll provide feedback on accuracy and relevance to help AI reflect real drilling workflows and energy industry practices. The hourly, project-based work has a flexible schedule, no minimum hours, and may fit alongside other commitments.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • drilling operations
  • drilling
  • completions
Data EngineeringView job

SME Careers

Physics Quality Assurance Lead (QAL)

Guide quality checks for physics AI training by reviewing generated explanations, calculations, diagrams, and contributor work against project rubrics. You will give specific feedback, answer physics and workflow questions, maintain contributor resources, and address recurring quality gaps. The role is remote and contract-based, requires native Punjabi fluency, and includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · India, United States
Engagement type
Contract
Compensation
Up to $75/hr
  • physics
  • classical mechanics
  • electromagnetism
Quality Assurance & TestingView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.