AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Handshake AI

Solar Design Engineer

Use your energy industry experience to create training examples and assess AI responses about project development and cost estimation. The work draws on hands-on knowledge of estimation, pre-construction, or solar design tools. Projects are remote and project-based, with a flexible schedule, no minimum hours, and a typical commitment of about 5–20 hours per week during active projects. Placement depends on project needs, with future projects also possible.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • energy project estimation
  • pre-construction
  • solar design
Sales Engineering & Solutions ConsultingView job

AfterQuery

Producer and Director Expert

Create and assess media production challenges that help train AI models to apply film, television, and theater principles. You will build scenarios around creative decisions, storytelling, and project management, then review model answers against production practices and industry standards. The role calls for production leadership experience and strong communication and analytical skills.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • media production
  • film production
  • television production
Machine Learning & AIView job

Mercor

Japanese Linguistic Experts

Assess how well a large language model handles Japanese tasks such as translation, summaries, dialogue, and grammar correction. You will also refine Japanese text, annotate linguistic features, and give researchers detailed feedback that supports model training. The project pairs language expertise with AI research at a leading research lab.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • japanese
  • translation
  • editing
Language & LinguisticsView job

Handshake AI

Math Expert

Use your advanced mathematics training in flexible, hourly, project-based work supporting AI research. You’ll write rigorous questions and assess AI answers for accuracy, logical consistency, and mathematical rigor, with a focus on mathematical reasoning, proofs, and technical problem-solving. Work takes place remotely on an asynchronous schedule, with no minimum hours; contributors often work about 5–20 hours a week during active projects. Placement depends on project needs.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $75/hr
  • mathematics
  • advanced mathematical reasoning
  • proof-writing
Machine Learning & AIView job

AfterQuery

Product Manager Expert

Shape how AI systems handle real product decisions. You’ll write scenarios drawn from ambiguous product problems, explain the reasoning behind a strong decision, and assess model responses to specs, roadmaps, and strategy. The work is remote and async, with a minimum commitment of 10 hours per week and no weekly maximum. AfterQuery hires contributors as independent contractors for ongoing project work.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$85/hr
  • product management
  • product strategy
  • product roadmaps
Product ManagementView job

Mercor

Chinese Linguistic Experts

Assess how well a large language model handles Chinese across translation, summaries, dialogue, and grammar correction. You’ll refine and annotate Chinese text, flag language issues, and share detailed feedback with AI researchers to support model training. The work calls for strong Chinese language expertise and professional experience with translation, editing, linguistic annotation, or NLP data.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • chinese
  • linguistic annotation
  • translation
Language & LinguisticsView job

Handshake AI

Land Administrator

Bring your upstream land or accounting experience to project-based AI research. You’ll write training questions and scenarios, assess model responses against real land administration and mineral title practices, and give structured feedback. Work at your own pace alongside your current commitments, with no set schedule or minimum hours.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $80/hr
  • land administration
  • mineral title
  • upstream accounting
Machine Learning & AIView job

AfterQuery

Literature Expert

AfterQuery engages literary scholars as independent contractors to create and assess close-reading scenarios for AI model evaluations. You will ground interpretations in textual evidence and judge model responses for fidelity, depth, and craft. Work is remote and asynchronous, with a minimum commitment of 10 hours each week, no fixed schedule, and ongoing projects. The selection process may include a written assessment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • close reading
  • literary analysis
  • comparative literature
Language & LinguisticsView job

Mercor

Hindi Linguistic Experts

Assess Hindi-language output from a large language model and prepare linguistic data that supports its training and improvement. You will review text across translation, summarization, dialogue, and grammar correction, then help an AI research team address language errors and gaps. The work calls for strong Hindi expertise and sound judgment on grammar, style, cultural context, and regional variation.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$30/hr
  • hindi
  • grammar
  • syntax
Language & LinguisticsView job

Handshake AI

Production Engineer

Use at least two years of experience in reservoir engineering, subsurface analysis, or production operations to create expert training data and assess AI responses. You’ll share feedback on accuracy, relevance, and subsurface workflows. The remote, project-based work has a flexible schedule with no minimum hours; contributors often work 5–20 hours per week during active projects. No AI background is required, and placement depends on project needs.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • reservoir engineering
  • subsurface analysis
  • production operations
Machine Learning & AIView job

Mercor

Arabic Linguistic Experts

Assess how well a large language model handles Arabic tasks such as translation, summarization, dialogue, and grammar correction. You will refine Arabic text, annotate linguistic features, and share findings with AI researchers to support model training. The role calls for native or near-native Arabic fluency and professional experience with Arabic language work.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • arabic
  • arabic grammar
  • arabic syntax
Language & LinguisticsView job

Handshake AI

Marketing Manager

Use your retail marketing or CRM experience to create expert training data and assess AI-generated responses for accuracy and relevance. The ongoing, project-based work centers on promotional planning, customer nurture emails, and competitive monitoring. You can work remotely on a flexible schedule, with no minimum hours; contributors typically spend 5–20 hours per week during active projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail marketing
  • customer relationship management
  • promotional campaign planning
Marketing & Brand ManagementView job

Mercor

German Linguistic Experts

Assess how well a large language model handles German across translation, summaries, dialogue, and grammar correction. You’ll refine German text, annotate linguistic features, and share analysis that helps researchers address language gaps and improve the model’s German output. The work calls for native or near-native German and professional experience with language-focused tasks.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • german
  • linguistic annotation
  • translation
Language & LinguisticsView job

Handshake AI

Visual Design Professional

As a Handshake AI Fellowship participant, you’ll help assess and develop how large language models handle visual storytelling, brand design, and professional communication. Work remotely on flexible, self-scheduled project assignments with no minimum hour commitment. Projects may involve writing design-focused prompts, reviewing model responses, and researching topics with AI. Placement depends on project availability, and the fellowship runs year-round with openings that vary by design specialty.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$100–$125/hr
  • visual design
  • brand design
  • product design
Design & CreativeView job

Mercor

Spanish Linguistic Experts

Assess how well a large language model handles Spanish tasks such as translation, summarization, dialogue, and grammar correction. You will also refine Spanish text, annotate linguistic features, and give researchers detailed feedback on errors, language gaps, and cultural fit. The work supports model training and improvement through high-quality Spanish data and expert linguistic judgment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • spanish
  • translation
  • editing
Language & LinguisticsView job

Handshake AI

Career and Technical Education Professors

College vocational instructors and technical education teachers can apply their workplace expertise to an hourly, temporary AI research project. You’ll review AI-generated material in your field and give clear, structured feedback about the tasks and language used in your work. No AI background is needed. Project openings appear throughout the year across different areas of expertise.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $75/hr
  • career and technical education
  • vocational instruction
  • technical education
Machine Learning & AIView job

Mercor

English Linguistic Experts

Assess English-language performance in a large language model and prepare linguistic data that supports its training and development. You will review text across tasks such as translation, summarization, dialogue, and grammar correction, then provide analysis to AI researchers. The project focuses on English language quality, including grammar, meaning, style, and cultural context.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$50/hr
  • english
  • linguistic annotation
  • translation
Language & LinguisticsView job

Handshake AI

Music Professional

Use your expertise in instrumental performance, composition, or music production to create training data and assess AI-generated music content. You’ll give feedback on accuracy and relevance across musical styles, traditions, and cultures. The remote work runs on a flexible, asynchronous schedule with no minimum hours; contributors often work about 5–20 hours per week during active projects. Project placement depends on current needs, with future projects also possible.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • instrumental performance
  • composition
  • music production
Machine Learning & AIView job

Mercor

Business Intelligence Analyst Talent Network

Apply to Mercor’s network for potential Business Intelligence Analyst projects with AI labs and other companies. After you submit your profile and pass an AI interview, Mercor may match you with work as projects open. Experts help train and evaluate AI models, build deliverables from real-world scenarios, and provide feedback. Projects vary in length and scope, with typical commitments of 15–30 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70–$120/hr
  • sql
  • data querying
  • tableau
Data Science & AnalyticsView job

Handshake AI

Project Engineer

Use your energy industry experience to create expert training data and assess AI-generated content about project development and cost estimation. The work draws on knowledge of energy project estimation, construction planning, or solar design. It is remote, project-based contract work with a flexible schedule and no minimum hours; contributors often work 5–20 hours per week during active projects. No AI experience is needed.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • energy project estimation
  • pre-construction
  • solar design
Sales Engineering & Solutions ConsultingView job

Showing 20 active roles of 323. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.