AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Turing

AI Quality Analyst (Personalization) - Spanish

Evaluate personalized Gemini responses in Spanish for relevance and accuracy.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • spanish
  • gemini
  • prompt engineering
Language & LinguisticsView job

Meridial by Invisible

Audio Evaluations: JSON & Coding Expert (German, Germany)

Review AI-generated coding, technical customer service, virtual agent, JSON, and audio-related content. You’ll check technical accuracy, clarity, natural German, and usefulness against project guidelines. The role calls for native-level German as used in Germany, but you do not need to live there. You’ll complete a German fluency introduction and a JSON Skills Assessment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$11/hr
  • german
  • json
  • coding
Language & LinguisticsView job

SME Careers

Punjabi Team Lead with Mathematical Background

Lead Punjabi quality review across AI training projects, checking contributor work and generated content against project rubrics. You will guide trainers and QAs, resolve language questions, and maintain resources such as style guides and onboarding materials using Discord, Google Docs, and Google Sheets. The contract role requires a mathematics degree, strong Punjabi and English, and at least three years of related professional experience. The selection process includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · Canada, India, Pakistan
Engagement type
Contract
Compensation
Up to $25/hr
  • punjabi
  • english
  • mathematics
Language & LinguisticsView job

General Translation · via Mercor

European Portuguese Linguistic Expert

Assess how well an LLM handles European Portuguese across translation, summarization, dialogue, and grammar correction. You will also refine and annotate language data, then share linguistic findings with AI researchers to support model improvements. The work calls for native or near-native European Portuguese and professional English fluency, with a strong grasp of usage in Portugal and how it differs from Brazilian Portuguese.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • european portuguese
  • portuguese grammar
  • portuguese syntax
Language & LinguisticsView job

Handshake AI

Environmental Science Professional

Apply your environmental science expertise to an AI research project focused on how models interpret professional work and language. Project assignments may involve writing industry-specific prompts and assessing large language model responses. The program runs year-round, with projects opening at intervals; placement depends on available work. Contributors work remotely on a flexible schedule with no minimum hour commitment.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • environmental science
  • conservation science
  • environmental health
Science & ResearchView job

Turing

Clinical & Health Specialist

Develop and evaluate complex clinical tasks and scenarios for accuracy.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • clinical reasoning
  • chart review
  • clinical documentation
Healthcare & MedicalView job

Meridial by Invisible

Kansai (Japan) Translation and Localization Expert

Use native-level Kansai fluency and knowledge of how people speak across the region to evaluate voice recordings and audio samples. You will record spoken content, compare recordings with written text, and judge accuracy, clarity, naturalness, and alignment with project guidelines. The work calls for a strong ear for Kansai pronunciation, accents, phrasing, tone, and cultural nuance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$9/hr
  • kansai
  • japanese
  • voice recording
Language & LinguisticsView job

SME Careers

Indonesian Quality Assurance Lead (QAL)

Lead language quality across Indonesian AI training projects by reviewing model content and trainer or QA work against project rubrics. You will assess grammar, meaning, tone, cultural fit, and instruction-following, then give contributors clear feedback and maintain Indonesian-specific guidance. The role also covers onboarding, quality documentation, and contributor follow-up using tools such as Discord and Google Sheets.

Location and eligibility
Remote · Indonesia only
Engagement type
Contract
Compensation
Up to $25/hr
  • bahasa indonesia
  • indonesian
  • english
Quality Assurance & TestingView job

General Translation · via Mercor

Spanish (Venezuela) Linguistic Expert

Assess how well an LLM handles Venezuelan Spanish across translation, summaries, dialogue, and grammar correction. You will also refine and annotate Spanish data, then share language-specific findings with AI researchers to support model training. The role calls for near-native command of Venezuelan Spanish, professional English fluency, and experience with Spanish language work.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • spanish (venezuela)
  • english
  • translation
Language & LinguisticsView job

Handshake AI

Legal Professionals

Legal professionals contribute to a year-round AI research program by creating industry-specific prompts and assessing large language model responses. Projects aim to improve how AI handles real-world professional tasks and language. Work takes place remotely on an asynchronous schedule, with flexible hours and no minimum commitment. Project openings appear at intervals, and placement depends on availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $150/hr
  • legal research
  • legal writing
  • legal administration
LegalView job

Meridial by Invisible

Audio Evaluations: JSON & Coding Expert (Welsh)

Review AI-generated coding and technical customer service content, including virtual agent replies, JSON structures, and audio-related material. You’ll assess accuracy, clarity, natural Welsh, and usefulness against project guidelines. The role requires native-level Welsh as spoken in Wales, but you do not need to live in the United Kingdom. You’ll complete a language introduction and a JSON skills assessment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$11/hr
  • welsh
  • json
  • coding
Language & LinguisticsView job

SME Careers

Catalan Language Expert

Review AI-generated answers in Catalan and English, judging language quality, factual accuracy, and how well each response follows its prompt. You will score and compare model outputs, write prompts and model explanations, and record decisions in English. The work calls for advanced Catalan proficiency, structured linguistic QA, and careful use of reliable references.

Location and eligibility
Remote · Spain only
Engagement type
Full-time
Compensation
Up to $26/hr
  • catalan
  • english
  • fact-checking
Language & LinguisticsView job

General Translation · via Mercor

Spanish (Peru) Linguistic Expert

Assess how well a large language model handles Peruvian Spanish, then help strengthen its language skills with carefully curated data. You will review outputs across tasks such as translation, summarization, dialogue, and grammar correction, and provide linguistic analysis that guides model training. The work calls for expert knowledge of Peruvian Spanish and professional fluency in English.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • peruvian spanish
  • spanish grammar
  • spanish syntax
Language & LinguisticsView job

Handshake AI

STEM PhD (LATAM)

LATAM-based doctoral researchers and graduates in mathematics, chemistry, biology, physics, or engineering can contribute scientific expertise to projects that improve large language models. Work may include writing domain-specific prompts, assessing model responses, and researching topics with AI. The fellowship runs year-round, but project placement depends on availability. Contributors work remotely on flexible, asynchronous schedules; active projects often require 5–20 hours per week, with no minimum hour requirement.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$63/hr
  • mathematics
  • chemistry
  • biology
Machine Learning & AIView job

Turing

AI Quality Analyst (Personalization) - Portuguese

Evaluate AI personalization quality using your personal experiences and insights.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • portuguese
  • ai quality evaluation
  • personalization evaluation
Language & LinguisticsView job

Meridial by Invisible

Dutch speakers specialist

Assess Dutch audio and language model responses by comparing samples and judging their accuracy, fluency, naturalness, and overall quality. The work calls for a strong grasp of Dutch grammar, pronunciation, and speech patterns, including dialect variation. Individual evaluations take about 30 seconds to 4 minutes.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$1.3 fixed
  • dutch
  • dutch grammar
  • dutch spelling
Language & LinguisticsView job

SME Careers

Cantonese Quality Assurance Lead (QAL)

Lead quality reviews for Traditional Chinese Hong Kong and Cantonese AI training projects. You will assess generated content and contributor work against project rubrics, give actionable feedback in English, and guide remote trainers and reviewers through Hong Kong-specific language standards. The role is a contract opportunity with no immediate project; qualified experts may be contacted when relevant work becomes available.

Location and eligibility
Remote · Hong Kong only
Engagement type
Contract
Compensation
Up to $40/hr
  • cantonese
  • traditional chinese
  • hong kong chinese
Quality Assurance & TestingView job

General Translation · via Mercor

Spanish (Chile) Linguistic Expert

Assess how well a large language model handles Chilean Spanish across translation, summarization, dialogue, and grammar correction. You’ll refine text, annotate linguistic features, and give AI researchers detailed feedback on errors and language gaps. The work calls for strong command of Chilean Spanish and an understanding of how its regional usage differs from other Spanish varieties.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • chilean spanish
  • spanish grammar
  • spanish syntax
Language & LinguisticsView job

Handshake AI

Communication Professionals

Communication professionals with at least five years of experience in editing, news analysis, reporting, journalism, or writing can contribute to AI research projects. You’ll create industry-specific prompts and assess LLM responses to help AI better handle professional language and tasks. Work remotely on a flexible schedule with no minimum hours; project placement depends on availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • communication
  • editing
  • news analysis
Language & LinguisticsView job

Showing 20 active roles of 195. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.