AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Boron · via Mercor

Multilingual Inpatient Hospitalist (MD) — Clinical Documentation & AI Evaluation

A healthcare AI partner needs practicing inpatient hospitalists to assess hospital documentation and AI-generated notes. You will review H&Ps, progress notes, and discharge summaries, annotate encounter data, and provide clinical feedback. Applicants must hold an MD, practice inpatient medicine in the US, and speak, listen, and write English plus another listed language at C1 level or higher.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$170/hr
  • inpatient medicine
  • hospital medicine
  • clinical documentation
Health Informatics & Medical RecordsView job

SME Careers

Hebrew Team Lead

Lead quality checks across Hebrew AI training projects by reviewing generated content and trainer work against project rubrics. You will give contributors actionable feedback, answer language questions, and maintain resources such as Hebrew style guides and quality trackers. The role requires strong English communication and Hebrew language expertise. There is no immediate project; qualified candidates may be contacted for future work. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · Israel only
Engagement type
Contract
Compensation
Up to $55/hr
  • hebrew
  • english
  • hebrew quality assurance
Language & LinguisticsView job

Mercor

Audiobook QA Expert — French

Assess French (France) AI-narrated audiobooks from the perspective of a regular listener, while tracking speech accuracy, naturalness, and listening experience. You’ll mark specific errors in review tools and share where narration works or disrupts the story. The remote, part-time role calls for about 20 hours per week, or roughly four hours a day. Applicants may live anywhere; France or another French-speaking region is preferred.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$15–$20/hr
  • french
  • english
  • audiobook quality assurance
Language & LinguisticsView job

SME Careers

Korean Quality Assurance Lead (QAL)

Guide quality across Korean AI training projects by reviewing model outputs and trainer or QA work against project rubrics. You will give specific feedback, resolve questions about Korean usage, and keep contributor guidance current through Discord and Google Docs. The role is remote and contract-based, with no immediate project; qualified candidates may hear about future assignments through the expert network.

Location and eligibility
Remote · Eligible in 6 countries
Engagement type
Contract
Compensation
Up to $45/hr
  • korean
  • english
  • korean proofreading
Quality Assurance & TestingView job

SME Careers

Hindi Quality Assurance Lead (QAL)

As a Hindi Quality Assurance Lead, you will review Hindi AI-training content and contributor work against project rubrics. You will assess language accuracy, tone, cultural fit, and instruction-following, then give clear feedback and maintain resources such as Hindi style guides and Devanagari examples. The role also covers contributor onboarding, guideline updates, and recurring quality issues across Hindi projects.

Location and eligibility
Remote · India only
Engagement type
Contract
Compensation
Up to $25/hr
  • hindi
  • english
  • devanagari
Language & LinguisticsView job

SME Careers

Norwegian Team Lead

Lead Norwegian-language quality work for AI training projects by reviewing model content and contributor work against project rubrics. You’ll coach trainers and QA reviewers, answer questions on language standards, and maintain resources such as style guides and onboarding materials. The role is a remote contract with no immediate project; qualified candidates may be contacted when a suitable project becomes available.

Location and eligibility
Remote · Norway only
Engagement type
Contract
Compensation
Up to $60/hr
  • norwegian
  • bokmål
  • nynorsk
Language & LinguisticsView job

SME Careers

Ukrainian Team Lead

Guide quality across Ukrainian AI training projects by reviewing generated content and contributor work against project rubrics. You’ll coach trainers and QA reviewers, resolve questions about Ukrainian usage, and maintain the documentation that keeps standards consistent across a remote team. The role is a contract position and calls for professional Ukrainian and English, plus experience with language review or related workflows.

Location and eligibility
Remote · Eligible in 6 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • ukrainian
  • english
  • ukrainian grammar
Language & LinguisticsView job

SME Careers

Portuguese Quality Assurance Lead (QAL)

As a remote contractor, you will review Portuguese AI-training content and contributor work against project rubrics, with a focus on Brazil-specific language quality. You will give trainers and quality reviewers actionable feedback, resolve questions about grammar and cultural context, and maintain resources such as Portuguese style guides and Google Sheets trackers. This role has no immediate project; qualified candidates may be contacted when relevant work becomes available.

Location and eligibility
Remote · Brazil, Portugal
Engagement type
Contract
Compensation
Up to $35/hr
  • portuguese
  • english
  • localization qa
Language & LinguisticsView job

SME Careers

Filipino (Tagalog) Language Expert

Review Filipino/Tagalog AI responses or create reference answers that model accurate, natural writing. You will assess grammar, meaning, register, Taglish use, cultural fit, factual claims, and prompt compliance, then explain issues in English. This remote contractor role pays hourly; no project is active now, but qualified experts may be contacted when relevant work opens.

Location and eligibility
Remote · Philippines only
Engagement type
Contract
Compensation
Up to $20/hr
  • filipino
  • tagalog
  • english
Language & LinguisticsView job

SME Careers

Icelandic Language Expert

Review AI-generated Icelandic and create reference answers that model strong writing across general knowledge, customer support, education, and conversation. You will assess grammar, meaning, tone, cultural fit, factual claims, and prompt compliance, then explain your judgments in English. This hourly remote contract has no immediate project; qualified experts may receive invitations to relevant work through the network.

Location and eligibility
Remote · Iceland only
Engagement type
Contract
Compensation
Up to $55/hr
  • icelandic
  • english
  • copyediting
Language & LinguisticsView job

SME Careers

Hebrew Language Expert

Review and compare Hebrew and English AI responses, checking factual accuracy, reasoning, clarity, and fit with each prompt. You may also write bilingual training examples and model explanations. This remote, hourly contract role has no immediate project; qualified experts may receive invitations when relevant work becomes available.

Location and eligibility
Remote · Israel only
Engagement type
Contract
Compensation
Up to $50/hr
  • hebrew
  • english
  • bilingual evaluation
Language & LinguisticsView job

SME Careers

Danish Team Lead

Lead quality checks for Danish AI training projects by reviewing model outputs and contributor work against project rubrics. You will give written feedback, guide trainers and QA reviewers, answer language questions, and maintain Danish-specific reference materials. The contract role requires strong Danish and English, plus experience with Danish language QA and structured review workflows.

Location and eligibility
Remote · Denmark only
Engagement type
Contract
Compensation
Up to $55/hr
  • danish
  • english
  • danish grammar
Language & LinguisticsView job

SME Careers

Italian Quality Assurance Lead (QAL)

Guide quality across Italian AI training projects by reviewing contributor work and Italian-language content against project rubrics. You will give specific feedback, answer language questions, support onboarding, and maintain resources such as style guides and trackers. This remote contract has no immediate project; qualified candidates may be contacted first when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · Italy only
Engagement type
Contract
Compensation
Up to $45/hr
  • italian
  • english
  • italian grammar
Quality Assurance & TestingView job

SME Careers

Russian Language Expert

Review Russian-language AI content and create reference answers that show accurate grammar, natural phrasing, and appropriate cultural context. You will compare model responses, explain language and reasoning issues in English, and check claims when needed. The remote contract role requires native or near-native Russian, English at C1 or above, and at least three years of relevant language-focused experience.

Location and eligibility
Remote · Kazakhstan only
Engagement type
Contract
Compensation
Up to $25/hr
  • russian
  • english
  • copyediting
Language & LinguisticsView job

SME Careers

Ukrainian Language Expert

Review AI-generated Ukrainian and create reference answers that show accurate, natural writing across general knowledge, customer support, education, and conversation. You will assess grammar, meaning, tone, cultural fit, and prompt alignment, then explain your decisions in English at C1 level or higher. The role is a remote, hourly contract.

Location and eligibility
Remote · Ukraine only
Engagement type
Contract
Compensation
Up to $20/hr
  • ukrainian
  • english
  • copyediting
Language & LinguisticsView job

SME Careers

Attorney and Lawyer

Review and assess AI-generated legal responses, or create expert legal examples that show sound analysis and precise writing. You will check legal reasoning, authority, citations, procedural steps, and risk assumptions, then provide clear feedback or compare candidate answers. This remote contract role has no immediate project; qualified experts may be contacted when relevant work becomes available.

Location and eligibility
Remote · Eligible in 39 countries
Engagement type
Contract
Compensation
Up to $120/hr
  • legal research
  • legal writing
  • legal analysis
LegalView job

SME Careers

Bengali Team Lead

Lead quality checks across Bengali AI training projects by reviewing generated content and contributor work against project rubrics. You will coach trainers and QA reviewers, resolve language questions, and keep Bengali guidance current. The role calls for native or near-native Bengali, strong English, and experience assessing language quality, including regional usage and cultural context.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $25/hr
  • bengali
  • english
  • bengali quality assurance
Language & LinguisticsView job

SME Careers

Bulgarian Language Expert

In this remote, hourly contract role, you will assess AI-generated Bulgarian and create reference answers across areas such as education, customer support, translation, and everyday conversation. Apply native or near-native Bulgarian expertise to check grammar, meaning, tone, and cultural fit, then explain your judgments in written English. The work also calls for comparing model responses and producing strong Bulgarian rewrites.

Location and eligibility
Remote · Bulgaria only
Engagement type
Contract
Compensation
Up to $20/hr
  • bulgarian
  • english
  • copyediting
Language & LinguisticsView job

SME Careers

Finnish Team Lead

Lead quality across Finnish AI training projects by reviewing model outputs and contributor work against project rubrics. You will coach trainers and QA reviewers, resolve questions on Finnish language choices, and maintain the guidance they use, including standards for selkokieli. The work also covers contributor onboarding and activity follow-up, with team coordination through Discord and quality records in Google Sheets.

Location and eligibility
Remote · Finland only
Engagement type
Contract
Compensation
Up to $55/hr
  • finnish
  • english
  • finnish grammar
Language & LinguisticsView job

SME Careers

Vietnamese Team Lead

Lead quality workflows for Vietnamese AI training projects by reviewing trainer and QA work against project rubrics, correcting language issues, and aligning contributors on project standards. The role calls for native or near-native Vietnamese, strong English, and experience with language review or AI training. No project is active now; qualified candidates may be contacted when a suitable assignment becomes available.

Location and eligibility
Remote · Cambodia, United States, Vietnam
Engagement type
Contract
Compensation
Up to $25/hr
  • vietnamese
  • english
  • vietnamese grammar
Language & LinguisticsView job

Showing 20 active roles of 195. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.