AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Mercor

Bilingual Spanish Generalist Expert — AI Safety

Help evaluate how advanced AI models respond to sensitive topics in Spanish. You’ll write prompts, assess conversations against structured guidelines, and explain judgments about adversarial wording and escalation patterns. The project starts immediately. No AI or machine learning background is needed; the team provides workflow training.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$43–$47/hr
  • spanish
  • english
  • ai safety
Language & LinguisticsView job

SME Careers

German Team Lead

Lead quality workflows for German-language AI training projects by reviewing generated content and contributor work against project rubrics. You will coach trainers and QA reviewers, maintain German-specific guidance, and address recurring language or process issues. No project is active now; qualified applicants may be contacted for future work. The selection process includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · Austria, Germany
Engagement type
Contract
Compensation
Up to $60/hr
  • german
  • english
  • ai training
Language & LinguisticsView job

Mercor

Bilingual Hindi Generalist Expert — AI Safety

Help assess how AI models respond to sensitive topics in Hindi. You’ll write prompts, apply review guidelines, and explain your judgments about risky or adversarial language. The role calls for native or near-native Hindi and business-level written English. No AI or machine learning experience is needed; training covers the workflow. The project starts immediately.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$18–$22/hr
  • hindi
  • english
  • ai safety
Language & LinguisticsView job

SME Careers

Customer Service (Call Center) Expert

Use your call center expertise to shape natural conversations for speech-to-speech AI agents. You will act out customer support scenarios, assess and rank model responses, and check outputs for inaccuracies or bias. The role requires at least two years in customer service, one year in AI training, and C1+ spoken English; the English requirement is limited to US candidates.

Location and eligibility
Remote · Canada, United States
Engagement type
Contract
Compensation
Up to $30/hr
  • ai training
  • call center
  • customer service
Customer SupportView job

Mercor

Audiobook QA Expert — English (US)

Listen to AI-generated audiobooks in US and North American English and assess whether the narration sounds natural, accurate, and enjoyable. You’ll mark speech and audio issues in review tools, identify where the listening experience falters, and rate listener satisfaction. The role calls for native or near-native English fluency, regular audiobook listening, and availability for about 20 hours each week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$20–$25/hr
  • audiobook quality assurance
  • audio annotation
  • speech evaluation
Language & LinguisticsView job

SME Careers

Marathi Team Lead with Mathematical Background

As a remote contract Marathi Quality Assurance Lead, you will assess Marathi AI training content and contributor work against project rubrics. You will guide trainers and reviewers on language standards, investigate recurring quality problems, and maintain materials such as Marathi style guides and quality trackers. The selection process includes an AI interview, a domain-specific task, and a recruiter interview.

Location and eligibility
Remote · India, Mauritius, Pakistan
Engagement type
Contract
Compensation
Up to $25/hr
  • marathi
  • english
  • mathematics
Language & LinguisticsView job

Mercor

Biology & Life Sciences Domain Expert

Bring senior research expertise to the evaluation of AI systems in biology and the life sciences. You will assess scientific tasks and model responses, create precise problem specifications and reference solutions, and build research-level benchmarks in your specialty. The role suits a practicing specialist who can distinguish sound scientific reasoning from claims that only sound convincing.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$90–$140/hr
  • biology
  • life sciences
  • biochemistry
Science & ResearchView job

SME Careers

Danish Language Expert

Review AI-generated Danish and create reference answers that demonstrate accurate, natural writing. You will assess grammar, meaning, tone, register, and cultural fit, then explain issues and compare model responses. The role calls for native or near-native Danish, English at C1 or above, and at least three years of relevant language-focused experience or equivalent expertise.

Location and eligibility
Remote · Denmark, Germany, Greenland
Engagement type
Contract
Compensation
Up to $50/hr
  • danish
  • english
  • danish grammar
Language & LinguisticsView job

Boron · via Mercor

Certified Medical Coder (ICD-10) — Multilingual Clinical Documentation & AI Evaluation

Bring your medical coding and documentation expertise to the review of clinical records and AI-generated notes. You will check coding accuracy, annotate documentation, and share feedback that helps improve clinical AI tools. Applicants must live in the US, hold an active qualifying certification, and speak, read, and write English plus another language at C1 level or above.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$45–$65/hr
  • icd-10
  • medical coding
  • clinical documentation
Health Informatics & Medical RecordsView job

SME Careers

Polish Team Lead

Lead quality workflows for Polish AI training projects by reviewing Polish-language content and contributor work against project rubrics. You will give trainers and QAs specific feedback, address language and localization questions, and keep style guides and quality records current. The role calls for strong Polish and English, plus experience in language review; selection includes an AI interview, a domain-specific task, and a recruiter interview.

Location and eligibility
Remote · Poland only
Engagement type
Contract
Compensation
Up to $35/hr
  • polish
  • english
  • polish grammar
Language & LinguisticsView job

Mercor

Indonesian Linguistic Experts

Assess how well a large language model handles Indonesian across translation, summaries, dialogue, and grammar correction. You’ll refine and annotate Indonesian text, flag language gaps, and share detailed findings with AI researchers. Your work will support model training and improve its understanding and generation of Indonesian, with attention to grammar, cultural standards, and context.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$30/hr
  • indonesian
  • linguistic annotation
  • translation
Language & LinguisticsView job

SME Careers

Slovak Team Lead

Guide Slovak quality across AI training projects by reviewing model outputs and trainer work against project rubrics. You will give precise feedback, resolve language questions, and keep Slovak style guides and quality records current. The role also includes onboarding trainers and QAs, sharing project updates through Discord, and tracking contributor activity.

Location and eligibility
Remote · Slovakia only
Engagement type
Contract
Compensation
Up to $25/hr
  • slovak
  • english
  • slovak grammar
Language & LinguisticsView job

Mercor

Japanese Linguistic Experts

Assess how well a large language model handles Japanese tasks such as translation, summaries, dialogue, and grammar correction. You will also refine Japanese text, annotate linguistic features, and give researchers detailed feedback that supports model training. The project pairs language expertise with AI research at a leading research lab.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • japanese
  • translation
  • editing
Language & LinguisticsView job

SME Careers

Odia (Oriya) Team Lead

Lead quality review across Odia AI training projects by checking contributor work and model-generated text against project rubrics. You will guide trainers and reviewers on grammar, meaning, tone, and cultural fit, while maintaining Odia style guides and project records in tools such as Discord and Google Sheets. The role requires professional Odia language experience and clear written communication in English.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • odia
  • english
  • localization qa
Language & LinguisticsView job

Mercor

Chinese Linguistic Experts

Assess how well a large language model handles Chinese across translation, summaries, dialogue, and grammar correction. You’ll refine and annotate Chinese text, flag language issues, and share detailed feedback with AI researchers to support model training. The work calls for strong Chinese language expertise and professional experience with translation, editing, linguistic annotation, or NLP data.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • chinese
  • linguistic annotation
  • translation
Language & LinguisticsView job

SME Careers

Croatian Team Lead

Lead quality checks for Croatian-language AI training work by reviewing generated content and contributor submissions against project rubrics. You’ll coach trainers and QA reviewers, resolve language questions, and maintain resources such as style guides, FAQs, and trackers. The role calls for native or near-native Croatian, strong English, and at least three years of relevant language or quality experience.

Location and eligibility
Remote · Croatia only
Engagement type
Contract
Compensation
Up to $30/hr
  • croatian
  • english
  • croatian grammar
Language & LinguisticsView job

Mercor

Telugu Linguistic Experts

Assess how well an LLM handles Telugu across translation, summarization, dialogue, and grammar correction. You’ll refine Telugu text, annotate linguistic features, and share detailed findings with AI researchers. The project also involves curating language data to support the model’s training and improve its Telugu comprehension and generation.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$30/hr
  • telugu
  • linguistic annotation
  • translation
Language & LinguisticsView job

SME Careers

Latvian Team Lead

Guide quality across Latvian AI training projects by reviewing contributor work and model-generated content against project rubrics. You will give specific feedback, resolve language questions, run onboarding, and maintain resources such as Latvian style guides and quality trackers, using Discord and Google Docs to coordinate with trainers and QA reviewers. No project is active now; qualified candidates may be contacted when a suitable assignment opens.

Location and eligibility
Remote · Latvia only
Engagement type
Contract
Compensation
Up to $25/hr
  • latvian
  • english
  • latvian grammar
Language & LinguisticsView job

Mercor

Hindi Linguistic Experts

Assess Hindi-language output from a large language model and prepare linguistic data that supports its training and improvement. You will review text across translation, summarization, dialogue, and grammar correction, then help an AI research team address language errors and gaps. The work calls for strong Hindi expertise and sound judgment on grammar, style, cultural context, and regional variation.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$30/hr
  • hindi
  • grammar
  • syntax
Language & LinguisticsView job

SME Careers

Latvian Language Expert

Review AI-produced Latvian text and write reference answers that demonstrate accurate, natural language use. You will assess grammar, meaning, tone, register, and cultural fit, then explain issues in English and compare model responses. The role uses an hourly remote contractor workflow and calls for native or near-native Latvian plus professional English proficiency.

Location and eligibility
Remote · Latvia only
Engagement type
Contract
Compensation
Up to $20/hr
  • latvian
  • english
  • latvian grammar
Language & LinguisticsView job

Showing 20 active roles of 195. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.