AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Mercor

Arabic Linguistic Experts

Assess how well a large language model handles Arabic tasks such as translation, summarization, dialogue, and grammar correction. You will refine Arabic text, annotate linguistic features, and share findings with AI researchers to support model training. The role calls for native or near-native Arabic fluency and professional experience with Arabic language work.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • arabic
  • arabic grammar
  • arabic syntax
Language & LinguisticsView job

SME Careers

Gujarati Expert with Mathematical Background

Use your mathematics education and Gujarati expertise to shape AI training content. You will review generated responses, write reference answers, and compare outputs for accuracy, grammar, tone, and cultural fit. The work spans prompts in areas such as education, customer support, general knowledge, and conversational writing, with written feedback in English.

Location and eligibility
Remote · India, United Kingdom, United States
Engagement type
Contract
Compensation
Up to $20/hr
  • gujarati
  • mathematics
  • english
Language & LinguisticsView job

Mercor

Turkish Linguistic Experts

Assess Turkish-language output from a large language model across translation, summarization, dialogue, and grammar correction. You will also refine Turkish text, annotate linguistic features, and share detailed findings with AI researchers who use your input to improve the model’s Turkish understanding and generation.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • turkish
  • linguistic annotation
  • translation
Language & LinguisticsView job

SME Careers

Telugu Expert with Mathematical Background

Use your mathematics education and Telugu expertise to shape AI language quality. You will write prompts and reference answers, assess AI-generated Telugu for meaning, grammar, tone, and cultural fit, and compare responses across topics such as education and customer support. The work also calls for clear English feedback, fact-checking, and close review of reasoning and policy risks.

Location and eligibility
Remote · India, United Arab Emirates, United States
Engagement type
Contract
Compensation
Up to $20/hr
  • telugu
  • english
  • mathematics
Language & LinguisticsView job

Mercor

German Linguistic Experts

Assess how well a large language model handles German across translation, summaries, dialogue, and grammar correction. You’ll refine German text, annotate linguistic features, and share analysis that helps researchers address language gaps and improve the model’s German output. The work calls for native or near-native German and professional experience with language-focused tasks.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • german
  • linguistic annotation
  • translation
Language & LinguisticsView job

SME Careers

Marathi Expert with Mathematical Background

Review AI-generated Marathi text and create reference answers that show accurate grammar, natural phrasing, and sound reasoning. You will compare model responses, check factual and cultural fit, and explain language issues in written English. The role requires a mathematics degree, advanced Marathi reading and writing, and at least three years of relevant professional experience; it follows an hourly remote contractor workflow.

Location and eligibility
Remote · India, Mauritius, Pakistan
Engagement type
Contract
Compensation
Up to $20/hr
  • marathi
  • english
  • mathematics
Language & LinguisticsView job

Mercor

Portuguese Linguistic Experts

Assess Portuguese-language outputs from a large language model and help build linguistic data that supports its training and improvement. You’ll review translation, summarization, dialogue, and grammar correction, then refine content and document language issues. The work calls for strong command of Portuguese grammar, style, regional variation, and context, alongside professional language or annotation experience.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • portuguese
  • linguistic annotation
  • translation
Language & LinguisticsView job

SME Careers

Hungarian Language Expert

Review AI-generated Hungarian responses or create reference answers that show accurate, natural writing. You will judge grammar, meaning, tone, cultural fit, and prompt adherence, then explain issues in English and compare candidate responses. The work calls for native or near-native Hungarian, C1 English, and at least three years of language-focused professional experience.

Location and eligibility
Remote · Hungary only
Engagement type
Contract
Compensation
Up to $25/hr
  • hungarian
  • english
  • copyediting
Language & LinguisticsView job

Mercor

Spanish Linguistic Experts

Assess how well a large language model handles Spanish tasks such as translation, summarization, dialogue, and grammar correction. You will also refine Spanish text, annotate linguistic features, and give researchers detailed feedback on errors, language gaps, and cultural fit. The work supports model training and improvement through high-quality Spanish data and expert linguistic judgment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • spanish
  • translation
  • editing
Language & LinguisticsView job

SME Careers

Nepali Team Lead with Mathematical Background

Lead quality checks for Nepali AI training projects by reviewing contributor work and generated content against project rubrics. You will guide trainers and QA reviewers, address language questions, and keep project references current. The role calls for a mathematics degree, professional Nepali language experience, and clear English communication; day-to-day coordination uses Discord, Google Docs, and Google Sheets.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $20/hr
  • nepali
  • english
  • mathematics
Language & LinguisticsView job

Mercor

English Linguistic Experts

Assess English-language performance in a large language model and prepare linguistic data that supports its training and development. You will review text across tasks such as translation, summarization, dialogue, and grammar correction, then provide analysis to AI researchers. The project focuses on English language quality, including grammar, meaning, style, and cultural context.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • english
  • linguistic annotation
  • translation
Language & LinguisticsView job

SME Careers

Russian Team Lead

Guide quality across Russian-language AI training projects by reviewing generated content and contributor work against project rubrics. You will give trainers and QA reviewers actionable feedback, answer language questions, lead onboarding, and maintain Russian style guides and quality records. The role calls for native or near-native Russian, strong English, and at least three years of relevant language or review experience.

Location and eligibility
Remote · Eligible in 11 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • russian
  • english
  • russian grammar
Language & LinguisticsView job

Mercor

Audiobook QA Expert — Italian

Review Italian (Italy) AI-narrated audiobooks from home, listening for accuracy, natural delivery, and an enjoyable experience. You’ll mark speech errors and audio issues in review tools, then assess how well the narration holds up for listeners. The work is part-time, about 20 hours per week or four hours a day. Applicants can live anywhere, with a preference for people in regions where Italian is spoken natively.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$15–$20/hr
  • italian
  • english
  • audiobook quality assurance
Language & LinguisticsView job

SME Careers

Dutch Team Lead

Lead Dutch quality work across AI training projects by reviewing generated content and contributor submissions against project rubrics. You will assess Dutch language quality across grammar, tone, cultural fit, and meaning, then guide trainers and QAs through feedback, onboarding, and project updates. The role also calls for clear English communication and organized upkeep of quality documentation for remote teams.

Location and eligibility
Remote · Belgium, Netherlands
Engagement type
Contract
Compensation
Up to $50/hr
  • dutch
  • english
  • dutch grammar
Language & LinguisticsView job

Mercor

Audiobook QA Expert — Spanish (US)

Listen to AI-narrated audiobooks in US and North American Spanish, then assess their accuracy, naturalness, and appeal for listeners. You’ll mark speech errors and audio defects in review tools and share where the narration holds up or disrupts the listening experience. The role offers remote, part-time work at about 20 hours per week, or roughly four hours per day.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$15–$20/hr
  • spanish
  • audiobook quality assurance
  • audio annotation
Language & LinguisticsView job

SME Careers

Persian Language Expert

Review AI-generated Persian responses and create reference content, including prompts, model answers, and edits. Assess grammar, meaning, tone, cultural fit, factual claims, and right-to-left formatting; compare outputs and explain your ratings in English. The role requires native or near-native Persian, C1-level English, and at least three years of relevant language-focused experience.

Location and eligibility
Remote · Tajikistan only
Engagement type
Contract
Compensation
Up to $25/hr
  • persian
  • farsi
  • english
Language & LinguisticsView job

Mercor

Bilingual Chinese Generalist Expert — AI Safety

Help assess how advanced AI models respond to sensitive topics in Chinese. You’ll write Chinese prompts, classify conversations against structured guidelines, and explain judgments about adversarial wording and escalation patterns. The role requires Chinese fluency and business-level written English, but no AI or machine learning background. Training covers the review workflow, and the project starts immediately.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$48–$52/hr
  • chinese
  • english
  • prompt writing
Language & LinguisticsView job

SME Careers

Arabic Language Expert

Review Arabic and English AI responses or create bilingual training examples, with a focus on reasoning, accuracy, and clear explanations. You will check claims, spot flawed methods, and compare candidate answers using task rubrics. The work is remote and contract-based; there is no immediate project, but qualified experts may hear about relevant work through the network.

Location and eligibility
Remote · Egypt, Saudi Arabia, South Africa
Engagement type
Contract
Compensation
Up to $15/hr
  • arabic
  • english
  • modern standard arabic
Language & LinguisticsView job

Mercor

Audiobook QA Expert — German

Assess German (Germany) text-to-speech audiobooks from a listener’s perspective, checking whether the narration sounds natural, accurate, and enjoyable. You’ll mark speech errors and audio artifacts in review tools, then report how each issue affects the listening experience. The work is remote and part-time, with an expected commitment of about 20 hours per week. Applicants can live anywhere, though Germany or another German-speaking region is preferred.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$15–$20/hr
  • german
  • audiobook evaluation
  • text-to-speech
Language & LinguisticsView job

SME Careers

Swedish Language Expert

Review AI-generated Swedish and create reference answers that show accurate grammar, natural phrasing, and appropriate tone. You will compare model responses, check facts and cultural context, and explain language issues in written feedback. The work calls for native or near-native Swedish, C1-level English, and at least three years of language-focused professional experience.

Location and eligibility
Remote · Finland, Sweden
Engagement type
Contract
Compensation
Up to $55/hr
  • swedish
  • english
  • copyediting
Language & LinguisticsView job

Showing 20 active roles of 195. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.