AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Turing

Business Analyst (Korean Language)

Analyze content and improve AI models using Korean and English insights.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • korean
  • english
  • business analysis
Business Analysis & StrategyView job

Meridial by Invisible

Cordobes (Argentina) Translation and Localization Expert

Independent contractors with native-level Cordobes fluency will record voice content and evaluate audio against written text. The work calls for a strong grasp of how Cordobes sounds in Argentina, including its pronunciation, accents, phrasing, tone, and cultural nuance. You will assess each sample for accuracy, clarity, naturalness, and alignment with detailed project guidelines.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$9/hr
  • cordobes
  • audio evaluation
  • voice recording
Language & LinguisticsView job

Ethos

Training / Onboarding / L&D Specialist

Apply your learning and development experience to help train a foundational AI lab’s language model on professional documents, spreadsheets, and slide decks. You’ll create, assess, and refine materials for onboarding, facilitator training, curriculum planning, engagement tracking, manager enablement, and skills assessment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • learning and development
  • corporate training
  • onboarding
Machine Learning & AIView job

SME Careers

Slovak Language Expert

Review AI-generated Slovak and write reference answers that show strong grammar, natural phrasing, and cultural awareness. You will compare model responses, assess meaning and tone, check claims when needed, and explain issues in written English. The work runs remotely on an hourly contractor basis and calls for native or near-native Slovak and C1-level English.

Location and eligibility
Remote · Slovakia only
Engagement type
Contract
Compensation
Up to $20/hr
  • slovak
  • english
  • copyediting
Language & LinguisticsView job

General Translation · via Mercor

Korean Linguistic Expert

Assess Korean-language output from a large language model and prepare linguistic data that supports its training and improvement. You will review translation, summarization, dialogue, and grammar correction, then use your expertise in Korean linguistics and language annotation to flag errors and guide AI researchers. The project partners with a leading research lab.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • korean
  • english
  • korean linguistics
Language & LinguisticsView job

AfterQuery

Court Interpreter Expert

AfterQuery engages certified court interpreters to create and assess legal interpretation scenarios used to evaluate AI models. You will draw on courtroom and legal experience to write reference interpretations, explain terminology and register choices, and judge whether model responses preserve the intended legal meaning in both working languages. The work is remote, asynchronous contract work with a minimum commitment of 10 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$80/hr
  • court interpreting
  • legal terminology
  • legal interpretation
Language & LinguisticsView job

Handshake AI

Financial Services Professionals

Financial services professionals with at least four years of experience can contribute to a year-round AI research program. Project work may include writing industry-specific prompts and reviewing large language model responses to help improve AI understanding of professional tasks and language. Work is remote, asynchronous, and flexible, with no minimum hours. Project placement depends on availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • financial services
  • credit authorization
  • financial risk
Finance & AccountingView job

Turing

Business Analyst (Finnish Language)

Analyze content in Finnish and provide feedback to improve AI models.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • finnish
  • english
  • business analysis
Business Analysis & StrategyView job

Meridial by Invisible

Audio Evaluations: JSON & Coding Expert (Multiple Languages)

As an independent contractor, you will assess AI-generated technical and customer-facing responses for clarity, usefulness, natural language, and accuracy. The work centers on JSON structure and formatting, alongside coding knowledge and customer service judgment. Choose a language cohort that matches your fluency, then complete a language introduction and JSON assessment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$11/hr
  • json
  • coding
  • audio evaluation
Language & LinguisticsView job

Ethos

Management Consultant (Advisory & Transformation)

Help a leading foundational AI lab improve its language model’s presentation work. You’ll create, assess, and refine slide decks for consulting workflows, drawing on at least four years in a top consulting, strategy, or advisory practice. The role is remote and part-time, with hours shaped by client task volume and no guaranteed weekly hours; most experts work under 10 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$80/hr
  • management consulting
  • strategy consulting
  • advisory
Business Analysis & StrategyView job

SME Careers

Bulgarian Team Lead

Lead quality review for Bulgarian AI training projects by checking generated content and trainer/QA work against project rubrics. You will give written feedback, coordinate contributor updates through Discord, and maintain Bulgarian style guides and quality records in Google Docs and Google Sheets. The selection process includes an AI interview, a domain-specific task, and a recruiter interview.

Location and eligibility
Remote · Bulgaria only
Engagement type
Contract
Compensation
Up to $25/hr
  • bulgarian
  • english
  • bulgarian grammar
Language & LinguisticsView job

General Translation · via Mercor

Latin American Spanish Linguistic Expert

Assess how well a large language model handles Spanish-language tasks, then refine and annotate Spanish data to support its training. You will review areas such as translation, summarization, dialogue, and grammar correction, applying native or near-native Latin American Spanish expertise and an understanding of regional usage.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • latin american spanish
  • spanish grammar
  • spanish syntax
Language & LinguisticsView job

AfterQuery

Linguistics Expert

AfterQuery’s expert data lab creates evaluation and training data for frontier AI labs. As a contract linguist, you’ll write scenarios that probe model reasoning in areas such as syntax, semantics, and phonology, then assess the accuracy of model analyses. The work runs remotely on an async schedule, with at least 10 hours of work each week and no set maximum.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • linguistics
  • syntax
  • semantics
Language & LinguisticsView job

Handshake AI

Human Resources Professional

Use your human resources experience to help shape AI research through work on business communication, strategy, and corporate storytelling. Projects may ask you to create domain-specific prompts or assess LLM responses, drawing on expertise in materials such as board presentations, business cases, investor presentations, client proposals, and executive communications. Work remotely on a flexible schedule with no minimum hour commitment; project placement depends on availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $75/hr
  • human resources
  • business communication
  • business strategy
Human ResourcesView job

Turing

Context and Conversation Evaluation Specialist

Review AI conversations to assess context and improve recommendations.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • conversation analysis
  • qualitative research
  • qualitative coding
Language & LinguisticsView job

Meridial by Invisible

Audio Evaluations: JSON & Coding Expert (Dutch, Netherlands)

Review AI-generated coding and technical customer service content, including virtual agent replies, JSON, and audio-related material. You will check accuracy, clarity, and usefulness against project guidelines. The role requires native-level Dutch as used in the Netherlands, but you do not need to live there. You will complete a language introduction and a JSON skills assessment, then submit your own work without LLMs, automation, or scripts.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$11/hr
  • dutch
  • json
  • coding
Language & LinguisticsView job

SME Careers

Malayalam Team Lead with Mathematical Background

Guide Malayalam quality across AI training projects by reviewing model outputs and contributor work against project rubrics. You will coach trainers and QA reviewers, resolve language questions, and maintain materials such as Malayalam style guides and quality trackers. The role calls for a mathematics degree, strong Malayalam and English, and at least three years in a relevant language or review workflow. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • malayalam
  • english
  • mathematics
Language & LinguisticsView job

General Translation · via Mercor

Polish Linguistic Expert

Assess how well an LLM handles Polish across translation, summarization, dialogue, and grammar correction. You will also refine Polish text, annotate language features, and share findings with AI researchers to support model training. The project calls for strong Polish language judgment, professional English, and experience with translation, editing, linguistic annotation, or Polish NLP data.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • polish
  • english
  • translation
Language & LinguisticsView job

AfterQuery

Literature Expert

AfterQuery engages literary scholars as independent contractors to create and assess close-reading scenarios for AI model evaluations. You will ground interpretations in textual evidence and judge model responses for fidelity, depth, and craft. Work is remote and asynchronous, with a minimum commitment of 10 hours each week, no fixed schedule, and ongoing projects. The selection process may include a written assessment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • close reading
  • literary analysis
  • comparative literature
Language & LinguisticsView job

Handshake AI

Engineering Professional

Contribute engineering expertise to an AI research project focused on how models interpret professional tasks and language. Project work may include writing industry-specific prompts and reviewing LLM responses. The program runs year-round, but project placement depends on availability. Work remotely on a flexible schedule, with no minimum hour commitment.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • mechanical engineering technology
  • electrical engineering
  • bioengineering
Machine Learning & AIView job

Showing 20 active roles of 195. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.