AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Turing

MLE Bench – Data Analyst

Analyze ML datasets to evaluate and improve system performance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • machine learning
  • python
  • sql
Machine Learning & AIView job

Meridial by Invisible

Multilingual AI Evaluator

Reviewers assess AI-generated content for accuracy, clarity, natural phrasing, and fit with project guidelines. You need C1-level fluency or higher in one of the requested languages and a strong grasp of its meaning, tone, phrasing, and cultural context. Projects come in batches, and availability depends on the language and project needs.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$9/hr
  • ai evaluation
  • french
  • arabic
Language & LinguisticsView job

SME Careers

Thai Team Lead

Lead Thai quality work across AI training projects by reviewing generated content and contributor output against project rubrics. You will give trainers and QA reviewers specific feedback, answer questions about Thai language and cultural conventions, and keep project guidance current in style guides and Google Docs. The role is a contract opportunity; no project is available immediately, but qualified candidates may be contacted for future work.

Location and eligibility
Remote · Eligible in 5 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • thai
  • english
  • thai grammar
Language & LinguisticsView job

General Translation · via Mercor

Chinese (Taiwan) Linguistic Expert

Assess a large language model (LLM) on Taiwanese Mandarin in Traditional Chinese, then help shape the language data used to improve its output. You will review text for accuracy and naturalness, apply Taiwan-specific linguistic and cultural standards, and share detailed findings with AI researchers. The work calls for strong command of Taiwanese Mandarin and professional English fluency.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • taiwanese mandarin
  • traditional chinese
  • translation
Language & LinguisticsView job

Meridial by Invisible

Audio Evaluations: JSON & Coding Expert (Portuguese, Brazil)

Review AI-generated coding and technical customer service content, including virtual agent replies, JSON, and audio-related material. You’ll check accuracy, clarity, natural language, and usefulness against project guidelines. The role requires native-level Brazilian Portuguese, but you do not need to live in Brazil. Selection includes a language introduction and a JSON assessment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$11/hr
  • brazilian portuguese
  • json
  • coding
Language & LinguisticsView job

SME Careers

Hindi Language Expert

Review and compare AI-generated Hindi content, check reasoning and factual accuracy, and write model answers that show sound methods. You will bring senior-level localization judgment to terminology, tone, and cultural nuance, using MQM/LQA principles and CAT tools to assess quality. The role is remote and hourly on a contract basis; the listing states that only candidates based in Hindi will be considered, and qualified experts may be contacted for future projects.

Location and eligibility
Remote · India only
Engagement type
Contract
Compensation
$5–$20/hr
  • hindi
  • english
  • translation
Language & LinguisticsView job

General Translation · via Mercor

Chinese (Singapore) Linguistic Expert

Assess how well an LLM handles Singaporean Chinese (Simplified) across translation, summarization, dialogue, and grammar correction. You’ll refine language data, annotate linguistic features, and share findings with AI researchers to support model training. The work calls for deep knowledge of local language use, including distinctions from Mainland, Taiwanese, and Hong Kong Chinese.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • singaporean chinese
  • simplified chinese
  • translation
Language & LinguisticsView job

Meridial by Invisible

Cantonese (Hong Kong) Translation and Localization Expert

Independent contractors with native-level Cantonese fluency and strong knowledge of Hong Kong usage will record voice content and assess audio samples. The work calls for close listening and careful comparison of spoken recordings with written text, with attention to pronunciation, clarity, natural phrasing, cultural nuance, and project guidelines.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$9/hr
  • cantonese
  • hong kong cantonese
  • translation
Language & LinguisticsView job

SME Careers

Kannada Team Lead with Mathematical Background

Guide Kannada quality across AI training projects by reviewing model outputs and contributor work against project rubrics. You will assess language accuracy, tone, cultural fit, and meaning, then coach trainers and QA reviewers through feedback, onboarding, and clear project documentation. The role calls for a Mathematics degree, strong Kannada and English, and at least three years of relevant language or review experience.

Location and eligibility
Remote · Eligible in 5 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • kannada
  • english
  • mathematics
Language & LinguisticsView job

General Translation · via Mercor

German Linguistic Expert

Assess German-language output from a large language model and prepare linguistic data that supports model training. You’ll review text for tasks such as translation, summaries, dialogue, and grammar correction, then flag language issues and share findings with AI researchers. The work calls for strong German language judgment and professional English fluency.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • german
  • english
  • linguistic annotation
Language & LinguisticsView job

Meridial by Invisible

Hindi (India) Dialect Voice Evaluation Expert: Awadhi, Bundeli, or Haryanvi

Evaluate voice and audio in the Hindi variety you know best: Awadhi, Bundeli, or Haryanvi. You’ll record voice content, review audio samples, and compare spoken recordings with written text for accuracy, clarity, naturalness, and adherence to project guidelines. The project is still scaling, so review timelines may vary. Selected applicants receive an email and may be considered for similar roles later.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$9/hr
  • hindi
  • awadhi
  • bundeli
Language & LinguisticsView job

SME Careers

Slovenian Team Lead

Guide quality across Slovenian AI training projects by reviewing generated content and contributor work against project rubrics. You will give specific feedback, answer language questions, support trainer onboarding, and maintain resources such as style guides and quality trackers. The role calls for native or near-native Slovenian, strong English, and experience with language review or related workflows; coordination happens through tools such as Discord and Google Sheets.

Location and eligibility
Remote · Slovenia only
Engagement type
Contract
Compensation
Up to $30/hr
  • slovenian
  • english
  • localization qa
Language & LinguisticsView job

General Translation · via Mercor

English (New Zealand) Linguistic Expert

Assess how well a large language model handles New Zealand English, then help improve its performance with carefully curated language data. You’ll review generated text for tasks such as translation, summarization, dialogue, and grammar correction, while applying your knowledge of New Zealand English to edits, annotations, and feedback for AI researchers.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • new zealand english
  • english grammar
  • english syntax
Language & LinguisticsView job

SME Careers

Maltese Language Expert

Review AI-generated Maltese and create reference answers that show accurate, natural language use. You will judge grammar, meaning, tone, register, and cultural fit, then explain errors and compare model responses using project guidelines. The role calls for native or near-native Maltese, C1-level English, and at least three years of relevant language-focused experience.

Location and eligibility
Remote · Malta only
Engagement type
Contract
Compensation
Up to $40/hr
  • maltese
  • english
  • copyediting
Language & LinguisticsView job

General Translation · via Mercor

Canadian English Linguistic Expert

Assess how well a large language model handles Canadian English across translation, summaries, dialogue, and grammar correction. You’ll also edit and annotate language data, flag cultural or linguistic mismatches, and share analysis with AI researchers working on model training. The project calls for strong knowledge of Canadian English, including how its usage differs from American and British English.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • canadian english
  • llm evaluation
  • linguistic annotation
Language & LinguisticsView job

SME Careers

Bengali Language Expert

Review and shape Bengali content used to train AI models. You will write reference answers, compare model responses, and assess language quality, factual accuracy, tone, and cultural fit across general knowledge, customer support, education, and conversational writing. The role is remote and contract-based, with written feedback provided in English.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $15/hr
  • bengali
  • english
  • grammar
Language & LinguisticsView job

General Translation · via Mercor

Australian English Linguistic Expert

Assess how well a large language model handles Australian English, then help improve its language data and outputs. You’ll review text for translation, summarization, dialogue, and grammar correction; refine content for Australian usage; and share linguistic analysis with AI researchers. The work calls for deep knowledge of Australian English and professional experience in language or NLP data work.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • australian english
  • linguistic annotation
  • translation
Language & LinguisticsView job

SME Careers

Romanian Language Expert

Review AI-generated Romanian and create reference answers that demonstrate accurate, natural writing. You will assess meaning, grammar, spelling, tone, cultural fit, and prompt compliance, then explain issues and provide clear corrections in English. The role requires native or near-native Romanian, at least C1 English, and three or more years of language-focused professional experience.

Location and eligibility
Remote · Romania only
Engagement type
Contract
Compensation
Up to $20/hr
  • romanian
  • english
  • copyediting
Language & LinguisticsView job

General Translation · via Mercor

British English Linguistic Expert

Assess how well a large language model handles British English in translation, summarization, dialogue, and grammar correction. You will refine and annotate language data, flag errors and gaps, and share detailed analysis with AI researchers to support model training. The project focuses on British usage, including regional variation, register, and cultural context.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • british english
  • linguistics
  • translation
Language & LinguisticsView job

SME Careers

Maltese Team Lead

Lead quality reviews for Maltese AI training projects by checking generated content and contributor work against project rubrics. You will coach trainers and QA reviewers, resolve language questions, maintain Maltese-specific guidance, and track contributor activity using tools such as Discord, Google Docs, and Google Sheets. The role calls for native or near-native Maltese and strong English.

Location and eligibility
Remote · Malta only
Engagement type
Contract
Compensation
Up to $45/hr
  • maltese
  • english
  • maltese grammar
Language & LinguisticsView job

Showing 20 active roles of 195. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.