AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

General Translation · via Mercor

Turkish Linguistic Expert

Assess Turkish-language output from a large language model and help shape the data used to improve its understanding and generation. You’ll review tasks such as translation, summaries, dialogue, and grammar correction, then annotate and refine Turkish text for accuracy, natural phrasing, and cultural fit. Your findings will inform AI researchers as they address model errors and language gaps.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • turkish
  • english
  • linguistic annotation
Language & LinguisticsView job

SME Careers

Slovenian Language Expert

Review AI-generated Slovenian and create reference answers that show accurate, natural language use. You will compare model responses, assess grammar, meaning, tone, and cultural fit, then give detailed feedback in English. The work also calls for fact-checking and careful review of reasoning, with attention to Slovenian-specific details such as cases, declension, and dual number.

Location and eligibility
Remote · Slovenia only
Engagement type
Contract
Compensation
Up to $25/hr
  • slovenian
  • english
  • copyediting
Language & LinguisticsView job

General Translation · via Mercor

Russian Linguistic Expert

Assess how well a large language model handles Russian, then help strengthen its language skills with carefully reviewed data. You will evaluate and refine text across translation, summarization, dialogue, and grammar correction, annotate linguistic features, and share findings with AI researchers on a project with a leading research lab.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • russian
  • english
  • translation
Language & LinguisticsView job

SME Careers

Mandarin Language Expert

Review and create Mandarin content for AI training, judging response quality, reasoning, and fidelity to the prompt. Apply China-specific localization expertise and MQM/LQA methods to identify language and factual issues, compare model answers, and write sound reference explanations. The work calls for native or near-native Mandarin, C1 or higher English, and at least five years of localization or translation experience.

Location and eligibility
Remote · Eligible in 21 countries
Engagement type
Contract
Compensation
Up to $40/hr
  • mandarin chinese
  • english
  • localization
Language & LinguisticsView job

General Translation · via Mercor

Romanian Linguistic Expert

Assess how well a large language model handles Romanian across translation, summarization, dialogue, and grammar correction. You will also refine Romanian text, annotate linguistic features, and share detailed findings with AI researchers. The project focuses on improving the model’s Romanian data and language capabilities.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • romanian
  • english
  • linguistic annotation
Language & LinguisticsView job

SME Careers

Finnish Language Expert

Review AI-generated Finnish and build reference answers that show strong grammar, accurate meaning, and appropriate tone. You will compare model responses, explain language and reasoning issues in English, and check for factual errors, cultural mismatches, and unsafe or misleading claims. The role requires native or near-native Finnish, C1 English, and at least three years of relevant language-focused experience.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $50/hr
  • finnish
  • english
  • copyediting
Language & LinguisticsView job

General Translation · via Mercor

Czech Linguistic Expert

Assess how well a large language model handles Czech, from translation and summaries to dialogue and grammar correction. You will also refine Czech-language material and annotate linguistic features to help improve the model’s understanding and generation. The work calls for expert Czech judgment, professional English, and experience with translation, editing, linguistic annotation, or Czech NLP data.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • czech
  • english
  • translation
Language & LinguisticsView job

SME Careers

Malay Quality Assurance Lead (QAL)

Lead quality reviews for Malay AI training work by checking generated content and contributor output against project rubrics. You will give trainers and QAs specific feedback, clarify language questions, and maintain guidance for regional usage, tone, and terminology. The role requires professional Malay language experience and strong English; no immediate project is available, but qualified candidates may be contacted for future work.

Location and eligibility
Remote · Malaysia only
Engagement type
Contract
Compensation
Up to $25/hr
  • bahasa melayu
  • malay
  • english
Language & LinguisticsView job

General Translation · via Mercor

Armenian Linguistic Expert

Assess how well a large language model handles Armenian across translation, summarization, dialogue, and grammar correction. You will refine Armenian text, annotate linguistic features, and share analysis that helps AI researchers address language gaps and improve model training. The work calls for expert knowledge of Armenian grammar, style, regional variation, and cultural context.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • armenian
  • english
  • linguistic annotation
Language & LinguisticsView job

SME Careers

Legal Quality Assurance Lead (QAL)

Lead quality checks for legal AI training work by reviewing model responses and contributor submissions against project rubrics. You will guide trainers and QAs, flag legal reasoning and safety issues, and maintain resources such as calibration tasks and style guides. This remote contract has no immediate project; qualified candidates may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $120/hr
  • legal quality assurance
  • legal reasoning
  • legal research
Quality Assurance & TestingView job

General Translation · via Mercor

Japanese Linguistic Expert

Assess how well an LLM handles Japanese across translation, summaries, dialogue, and grammar correction. You will also edit and annotate Japanese text, flag language and cultural issues, and share detailed feedback with AI researchers. The work calls for native or near-native Japanese fluency, professional English, and experience with Japanese language work such as translation, editing, or annotation.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • japanese
  • english
  • translation
Language & LinguisticsView job

SME Careers

Greek Language Expert

Review Greek AI responses and create reference answers that show accurate, natural writing. You will check Greek grammar, meaning, tone, cultural fit, and prompt alignment, then explain issues in written feedback. The work also involves comparing model responses and flagging factual errors, unsafe content, and reasoning problems.

Location and eligibility
Remote · Greece only
Engagement type
Contract
Compensation
Up to $25/hr
  • greek
  • english
  • copyediting
Language & LinguisticsView job

Mercor

Expert Project Manager

Manage projects that advance LLM browsing capabilities, with a focus on tracking project and annotator performance in Google Sheets, checking annotation quality, and communicating with contributors. The role suits someone who can organize work, analyze results, and take an unfamiliar problem from first steps through completion. Project or operations experience can help, but ownership matters most.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$50–$60/hr
  • project management
  • operations
  • google sheets
Operations & ManagementView job

SME Careers

Estonian Team Lead

Lead quality checks for Estonian AI training projects by reviewing generated content and contributor work against project rubrics. You will coach trainers and QA reviewers, resolve language questions, and keep Estonian style guides and quality records current. The role calls for strong written Estonian and English, plus experience with language-review workflows.

Location and eligibility
Remote · Estonia only
Engagement type
Contract
Compensation
Up to $40/hr
  • estonian
  • english
  • estonian grammar
Language & LinguisticsView job

Mercor

Audiobook QA Expert — Portuguese (Portugal)

Assess AI-narrated audiobooks in European Portuguese with the perspective of a regular listener and the precision of a reviewer. You’ll identify speech errors, mark their exact locations in review tools, and report how natural and enjoyable each recording feels. The remote, part-time role calls for about 20 hours per week, or roughly four hours per day.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$15–$20/hr
  • european portuguese
  • audiobook evaluation
  • audio annotation
Language & LinguisticsView job

SME Careers

Kannada Expert with Mathematical Background

Use your Kannada expertise and mathematics degree to assess AI-generated language and create reference answers across general knowledge, customer support, education, and conversation. You will judge grammar, meaning, tone, cultural fit, and prompt adherence, then explain issues in English. The role is remote and hourly, with a contractor workflow; selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · Eligible in 5 countries
Engagement type
Contract
Compensation
Up to $20/hr
  • kannada
  • mathematics
  • english
Language & LinguisticsView job

Mercor

Audiobook QA Expert — Dutch

Reviewers listen to Dutch (Netherlands) AI-narrated audiobooks and assess whether the speech sounds accurate, natural, and enjoyable. You’ll mark and categorize speech errors, then share where narration holds a listener’s attention or disrupts the experience. The remote, part-time schedule calls for about 20 hours per week, or roughly four hours per day.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$15–$20/hr
  • dutch
  • audiobook quality assurance
  • text-to-speech evaluation
Language & LinguisticsView job

SME Careers

Swedish Team Lead

Guide Swedish quality work across AI training projects by reviewing generated content and contributor submissions against project rubrics. You will give trainers and QA reviewers specific feedback, resolve language questions, and keep Swedish guidance current in Discord and project documentation. The role calls for native or near-native Swedish, strong English, and at least three years of relevant language or quality experience.

Location and eligibility
Remote · Sweden only
Engagement type
Contract
Compensation
Up to $60/hr
  • swedish
  • english
  • ai training
Language & LinguisticsView job

Boron · via Mercor

Multilingual Primary Care Physician, Clinical AI Evaluation

Apply your outpatient primary care experience to review clinical notes and assess AI-generated documentation for accuracy, completeness, and clinical soundness. You will annotate encounter data, flag gaps or errors, and give structured feedback that helps improve clinical documentation and decision-support tools. Applicants must practice in the US, hold an MD, and speak, listen, and write in English plus another listed language at C1 level or higher.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$170–$190/hr
  • primary care
  • family medicine
  • general internal medicine
Language & LinguisticsView job

SME Careers

Persian Team Lead

Lead Persian (Farsi) quality reviews across AI training projects by checking generated content and contributor work against project rubrics. You will give trainers and QA reviewers clear feedback, answer language and formatting questions, and maintain resources such as style guides and quality trackers. The work calls for strong Persian and English, sound judgment on language and culture, and experience with LLM evaluation or related review workflows.

Location and eligibility
Remote · Eligible in 8 countries
Engagement type
Contract
Compensation
Up to $25/hr
  • persian
  • farsi
  • english
Language & LinguisticsView job

Showing 20 active roles of 195. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.