AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Mercor

Turkish Linguistic Experts

Assess Turkish-language output from a large language model across translation, summarization, dialogue, and grammar correction. You will also refine Turkish text, annotate linguistic features, and share detailed findings with AI researchers who use your input to improve the model’s Turkish understanding and generation.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • turkish
  • linguistic annotation
  • translation
Language & LinguisticsView job

Handshake AI

Energy Billing Analyst

Use your energy industry experience to create training data and review AI responses about utility workflows and customer data management. The remote, hourly contract work has a flexible schedule, no minimum hour requirement, and no set weekly commitment. Contributors often work about 5–20 hours per week during active projects. Project placement depends on current needs, with consideration for future projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$85/hr
  • utility metering
  • customer operations
  • energy billing
Data Science & AnalyticsView job

SME Careers

Danish Team Lead

Lead quality checks for Danish AI training projects by reviewing model outputs and contributor work against project rubrics. You will give written feedback, guide trainers and QA reviewers, answer language questions, and maintain Danish-specific reference materials. The contract role requires strong Danish and English, plus experience with Danish language QA and structured review workflows.

Location and eligibility
Remote · Denmark only
Engagement type
Contract
Compensation
Up to $55/hr
  • danish
  • english
  • danish grammar
Language & LinguisticsView job

Turing

Real Estate Sales Agent

Use your real estate brokerage experience to help assess and improve AI systems. You will create property and negotiation scenarios, write structured solutions, and review model responses for accuracy, professionalism, and compliance. The work draws on knowledge of valuation, client consultations, closing processes, and buyer-seller dynamics. Prior AI experience is not required.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • real estate brokerage
  • real estate sales
  • deal negotiation
Sales Engineering & Solutions ConsultingView job

Mercor

German Linguistic Experts

Assess how well a large language model handles German across translation, summaries, dialogue, and grammar correction. You’ll refine German text, annotate linguistic features, and share analysis that helps researchers address language gaps and improve the model’s German output. The work calls for native or near-native German and professional experience with language-focused tasks.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • german
  • linguistic annotation
  • translation
Language & LinguisticsView job

Handshake AI

Project Engineer

Use your energy industry experience to create expert training data and assess AI-generated content about project development and cost estimation. The work draws on knowledge of energy project estimation, construction planning, or solar design. It is remote, project-based contract work with a flexible schedule and no minimum hours; contributors often work 5–20 hours per week during active projects. No AI experience is needed.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • energy project estimation
  • pre-construction
  • solar design
Sales Engineering & Solutions ConsultingView job

SME Careers

Italian Quality Assurance Lead (QAL)

Guide quality across Italian AI training projects by reviewing contributor work and Italian-language content against project rubrics. You will give specific feedback, answer language questions, support onboarding, and maintain resources such as style guides and trackers. This remote contract has no immediate project; qualified candidates may be contacted first when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · Italy only
Engagement type
Contract
Compensation
Up to $45/hr
  • italian
  • english
  • italian grammar
Quality Assurance & TestingView job

Turing

AI Quality Analyst (Personalization) - Arabic

Evaluate Arabic AI responses using personal context for relevance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • arabic
  • gemini
  • google account
AI evaluationView job

Mercor

Portuguese Linguistic Experts

Assess Portuguese-language outputs from a large language model and help build linguistic data that supports its training and improvement. You’ll review translation, summarization, dialogue, and grammar correction, then refine content and document language issues. The work calls for strong command of Portuguese grammar, style, regional variation, and context, alongside professional language or annotation experience.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • portuguese
  • linguistic annotation
  • translation
Language & LinguisticsView job

SME Careers

Russian Language Expert

Review Russian-language AI content and create reference answers that show accurate grammar, natural phrasing, and appropriate cultural context. You will compare model responses, explain language and reasoning issues in English, and check claims when needed. The remote contract role requires native or near-native Russian, English at C1 or above, and at least three years of relevant language-focused experience.

Location and eligibility
Remote · Kazakhstan only
Engagement type
Contract
Compensation
Up to $25/hr
  • russian
  • english
  • copyediting
Language & LinguisticsView job

Turing

Intellectual Property Law Expert

Evaluate AI reasoning on U.S. intellectual property legal questions.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • intellectual property law
  • patent prosecution
  • patent eligibility
AI evaluationView job

Mercor

Spanish Linguistic Experts

Assess how well a large language model handles Spanish tasks such as translation, summarization, dialogue, and grammar correction. You will also refine Spanish text, annotate linguistic features, and give researchers detailed feedback on errors, language gaps, and cultural fit. The work supports model training and improvement through high-quality Spanish data and expert linguistic judgment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • spanish
  • translation
  • editing
Language & LinguisticsView job

SME Careers

Ukrainian Language Expert

Review AI-generated Ukrainian and create reference answers that show accurate, natural writing across general knowledge, customer support, education, and conversation. You will assess grammar, meaning, tone, cultural fit, and prompt alignment, then explain your decisions in English at C1 level or higher. The role is a remote, hourly contract.

Location and eligibility
Remote · Ukraine only
Engagement type
Contract
Compensation
Up to $20/hr
  • ukrainian
  • english
  • copyediting
Language & LinguisticsView job

Turing

Medical Expert – Dermatology

Review AI-generated dermatology content for accuracy and safety.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • dermatology
  • medical content review
  • clinical evaluation
AI evaluationView job

Mercor

English Linguistic Experts

Assess English-language performance in a large language model and prepare linguistic data that supports its training and development. You will review text across tasks such as translation, summarization, dialogue, and grammar correction, then provide analysis to AI researchers. The project focuses on English language quality, including grammar, meaning, style, and cultural context.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • english
  • linguistic annotation
  • translation
Language & LinguisticsView job

SME Careers

Attorney and Lawyer

Review and assess AI-generated legal responses, or create expert legal examples that show sound analysis and precise writing. You will check legal reasoning, authority, citations, procedural steps, and risk assumptions, then provide clear feedback or compare candidate answers. This remote contract role has no immediate project; qualified experts may be contacted when relevant work becomes available.

Location and eligibility
Remote · Eligible in 39 countries
Engagement type
Contract
Compensation
Up to $120/hr
  • legal research
  • legal writing
  • legal analysis
LegalView job

Mercor

Business Intelligence Analyst Talent Network

Apply to Mercor’s network for potential Business Intelligence Analyst projects with AI labs and other companies. After you submit your profile and pass an AI interview, Mercor may match you with work as projects open. Experts help train and evaluate AI models, build deliverables from real-world scenarios, and provide feedback. Projects vary in length and scope, with typical commitments of 15–30 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70–$120/hr
  • sql
  • data querying
  • tableau
Data Science & AnalyticsView job

SME Careers

Bengali Team Lead

Lead quality checks across Bengali AI training projects by reviewing generated content and contributor work against project rubrics. You will coach trainers and QA reviewers, resolve language questions, and keep Bengali guidance current. The role calls for native or near-native Bengali, strong English, and experience assessing language quality, including regional usage and cultural context.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $25/hr
  • bengali
  • english
  • bengali quality assurance
Language & LinguisticsView job

Mercor

Humanities Expert

Mercor maintains a standing pool of humanities scholars for AI training and evaluation projects, rather than hiring for one active opening. Matched experts develop field-based questions and reference answers, then assess model interpretations and arguments for sound use of sources, reasoning, and context. Apply with a resume, confirm your work location, and complete an AI interview of about 20 minutes. Project invitations may arrive within a week or after several months.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$45–$60/hr
  • history
  • classics
  • philosophy
AI evaluationView job

SME Careers

Bulgarian Language Expert

In this remote, hourly contract role, you will assess AI-generated Bulgarian and create reference answers across areas such as education, customer support, translation, and everyday conversation. Apply native or near-native Bulgarian expertise to check grammar, meaning, tone, and cultural fit, then explain your judgments in written English. The work also calls for comparing model responses and producing strong Bulgarian rewrites.

Location and eligibility
Remote · Bulgaria only
Engagement type
Contract
Compensation
Up to $20/hr
  • bulgarian
  • english
  • copyediting
Language & LinguisticsView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.