AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Meridial by Invisible

Hindi (India) Dialect Voice Evaluation Expert: Awadhi, Bundeli, or Haryanvi

Evaluate voice and audio in the Hindi variety you know best: Awadhi, Bundeli, or Haryanvi. You’ll record voice content, review audio samples, and compare spoken recordings with written text for accuracy, clarity, naturalness, and adherence to project guidelines. The project is still scaling, so review timelines may vary. Selected applicants receive an email and may be considered for similar roles later.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$9/hr
  • hindi
  • awadhi
  • bundeli
Language & LinguisticsView job

Turing · via Braintrust

QuickBooks Accounting Expert - AI Evaluation

Use your accounting background and QuickBooks Online experience to assess AI answers to bookkeeping, accounting, and small-business questions. The 12-week remote contract is open to contributors based in the United States, with a 20-hour weekly schedule or a 40-hour option. Both require four hours of overlap with Pacific Time working hours. Selection includes a profile review, and the team seeks contributors who can start soon.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$24/hr
  • quickbooks online
  • omnchat
  • accounting
Finance & AccountingView job

General Translation · via Mercor

Chinese (Taiwan) Linguistic Expert

Assess a large language model (LLM) on Taiwanese Mandarin in Traditional Chinese, then help shape the language data used to improve its output. You will review text for accuracy and naturalness, apply Taiwan-specific linguistic and cultural standards, and share detailed findings with AI researchers. The work calls for strong command of Taiwanese Mandarin and professional English fluency.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • taiwanese mandarin
  • traditional chinese
  • translation
Language & LinguisticsView job

Handshake AI

Quantitative Finance Researcher

Use your background in quantitative finance to create expert training material and assess AI-generated responses for accuracy and relevance. You’ll contribute feedback that helps AI systems handle quantitative finance research and methods. The work is remote, project-based, and hourly, with a flexible schedule and no minimum hours. Contributors typically work about 5–20 hours a week during active projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$75–$150/hr
  • quantitative finance
  • mathematical finance
  • financial engineering
Finance & AccountingView job

SME Careers

Biomedical Engineering Quality Assurance Lead (QAL)

Lead quality checks for biomedical engineering AI training work, reviewing generated explanations and contributor submissions against project rubrics. You will assess technical reasoning, calculations, units, safety, and regulatory claims, then guide trainers and reviewers through feedback, onboarding, and clear documentation. The role calls for at least three years of relevant professional experience and strong written English.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $105/hr
  • biomedical engineering
  • biomechanics
  • biomaterials
Quality Assurance & TestingView job

micro1

Family Medicine Physician

Family Medicine Physicians apply their primary care expertise to an AI training project. You will assess medical information, clinical scenarios, and AI-generated responses, then explain your findings and feedback. The work is remote and open to qualified physicians worldwide, with a part-time, project-based contractor arrangement. Applicants complete a short AI interview covering medical knowledge and relevant experience.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • clinical reasoning
  • primary care
  • medical content evaluation
Healthcare & MedicalView job

Ethos

Japanese Language & Cultural Fluency Consultant

Help a leading foundational AI lab train its language model by creating, reviewing, and refining professional documents, spreadsheets, and slide decks in Japanese and English. You will assess translation quality, localization, tone, cultural context, and business etiquette. Work remotely on your own schedule; task volume varies, and most experts work fewer than 10 hours per week. The role has no weekly cap on hours or earnings, and the start date is ASAP.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100/hr
  • japanese
  • english
  • translation
Language & LinguisticsView job

Turing

AI Quality Analyst (Personalization) - Polish

Evaluate AI personalization effectiveness using your own experiences and data.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$20/hr
  • polish
  • ai evaluation
  • personalization evaluation
AI evaluationView job

AfterQuery

Radioactive Materials & Health Physics Expert (AI Safety)

Help assess how AI models respond to safety-critical questions about radioactive materials and health physics. You will create evaluation prompts, judge work from other experts, and explain the technical basis for each safety decision. The work is remote and task-based, and you must be a citizen of and work from a Five Eyes country.

Location and eligibility
Remote · Eligible in 5 countries
Engagement type
Not specified
Compensation
$150/hr
  • health physics
  • radiochemistry
  • nuclear engineering
AI evaluationView job

Turing · via Braintrust

AI Assistant Evaluator - AI Research Study

Take part in a 16-week study that examines AI assistants through the lens of everyday users. You’ll review English prompts and responses for Gemini, Instinct, or Muse, then assess response quality and share feedback under the study guidelines. The schedule calls for 20 hours per week, with a 40-hour option, plus four hours of overlap with Pacific Time working hours.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$15/hr
  • gemini
  • instinct
  • muse
AI evaluationView job

General Translation · via Mercor

Chinese (Singapore) Linguistic Expert

Assess how well an LLM handles Singaporean Chinese (Simplified) across translation, summarization, dialogue, and grammar correction. You’ll refine language data, annotate linguistic features, and share findings with AI researchers to support model training. The work calls for deep knowledge of local language use, including distinctions from Mainland, Taiwanese, and Hong Kong Chinese.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • singaporean chinese
  • simplified chinese
  • translation
Language & LinguisticsView job

Handshake AI

Financial Services Professionals

Financial services professionals with at least four years of experience can contribute to a year-round AI research program. Project work may include writing industry-specific prompts and reviewing large language model responses to help improve AI understanding of professional tasks and language. Work is remote, asynchronous, and flexible, with no minimum hours. Project placement depends on availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • financial services
  • credit authorization
  • financial risk
Finance & AccountingView job

SME Careers

Kannada Team Lead with Mathematical Background

Guide Kannada quality across AI training projects by reviewing model outputs and contributor work against project rubrics. You will assess language accuracy, tone, cultural fit, and meaning, then coach trainers and QA reviewers through feedback, onboarding, and clear project documentation. The role calls for a Mathematics degree, strong Kannada and English, and at least three years of relevant language or review experience.

Location and eligibility
Remote · Eligible in 5 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • kannada
  • english
  • mathematics
Language & LinguisticsView job

micro1

Independent Professional & Solopreneur (Domain Expert)

Independent professionals and solopreneurs will apply their domain knowledge to assess real-world work and improve AI training materials. The project focuses on how AI handles practical tasks, including proposals, reports, client communications, and analyses. Prior AI experience is not needed. The role is remote and open to people in the US and Canada.

Location and eligibility
Remote · Canada, United States
Engagement type
Contract
Compensation
$40–$120/hr
  • domain-expertise
  • client-relationship-management
  • written-communication
Machine Learning & AIView job

Ethos

Brand Strategist / Brand Manager

Help train a leading foundational AI lab’s language model by creating, reviewing, and improving professional brand presentations and slide decks. Work spans brand strategy, positioning and architecture, campaign rationale, brand tracking, and annual plans. The role is fully remote with a flexible schedule. Hours depend on client task volume, are not guaranteed, and most experts work under 10 hours per week; there is no weekly hours cap. Start date: ASAP.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • brand strategy
  • brand management
  • powerpoint
Marketing & Brand ManagementView job

Turing

Biology Expert (PhD/Master’s)

Design and solve complex Biology problems to enhance AI language models.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • biology
  • molecular biology
  • cell biology
Science & ResearchView job

AfterQuery

Energy Expert

Use your energy-sector experience to help test and train AI models on realistic work from utilities, oil and gas, and power production. You’ll build practical scenarios, examine operational data, and spot errors in AI responses that require professional judgment. The project is remote and part time, with flexible hours and hourly pay.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • energy analysis
  • utility operations
  • oil and gas
Energy & Power GenerationView job

Google DeepMind · via Braintrust

Motion Designer / Creative Technologist

Google DeepMind seeks experienced motion designers and creative technologists for onsite AI training and evaluation projects. You’ll create reference animations and code-driven motion work, then assess model-generated content against professional standards. The role calls for at least five years of studio or agency experience, advanced After Effects skills, and practical coding experience. Candidates who advance complete a 15-minute AI interview, followed by a 45-minute technical interview.

Location and eligibility
On-site · United States only
Engagement type
Contract
Compensation
$30–$52/hr
  • motion design
  • adobe after effects
  • kinetic typography
Design & CreativeView job

General Translation · via Mercor

German Linguistic Expert

Assess German-language output from a large language model and prepare linguistic data that supports model training. You’ll review text for tasks such as translation, summaries, dialogue, and grammar correction, then flag language issues and share findings with AI researchers. The work calls for strong German language judgment and professional English fluency.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • german
  • english
  • linguistic annotation
Language & LinguisticsView job

Handshake AI

GRE Quantitative Instructor

Use your GRE quantitative teaching experience to create expert training material and assess AI-generated educational content. You will judge responses for accuracy, clarity, and instructional quality, with feedback on how AI explains quantitative concepts and supports learners. The remote work runs on a flexible, asynchronous, project-based schedule, with no minimum hours. Contributors often work 5–20 hours per week during active projects; placement depends on project needs.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100/hr
  • gre quantitative reasoning
  • gre tutoring
  • test preparation
AI evaluationView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.