AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

SME Careers

Slovenian Language Expert

Review AI-generated Slovenian and create reference answers that show accurate, natural language use. You will compare model responses, assess grammar, meaning, tone, and cultural fit, then give detailed feedback in English. The work also calls for fact-checking and careful review of reasoning, with attention to Slovenian-specific details such as cases, declension, and dual number.

Location and eligibility
Remote · Slovenia only
Engagement type
Contract
Compensation
Up to $25/hr
  • slovenian
  • english
  • copyediting
Language & LinguisticsView job

micro1

Interventional Cardiologist

An experienced interventional cardiologist will review AI-generated clinical content and assess cases involving coronary artery disease and catheter-based care. The work draws on expertise in coronary angiography, angioplasty, stent placement, and cardiovascular treatment decisions. Applicants need English at B2 level or above. The screening process includes an AI interview, a specialty assessment, and an onboarding call.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$80–$285/hr
  • interventional cardiology
  • coronary angiography
  • angioplasty
Health Informatics & Medical RecordsView job

Ethos

Real Estate / Hospitality / Events Professional

Create, assess, and refine documents, spreadsheets, and slide decks that help train a foundational AI model. Work across real estate, hospitality, and events workflows, including property listings, lease summaries, event schedules, venue proposals, guest service standards, and banquet orders. The role is fully remote, with a flexible schedule and task volume that varies. Most experts work under 10 hours per week, with no weekly cap; work can start as soon as possible.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • real estate transactions
  • hospitality operations
  • event production
Machine Learning & AIView job

Turing

Business Analyst (Korean Language)

Analyze content and improve AI models using Korean and English insights.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • korean
  • english
  • business analysis
Business Analysis & StrategyView job

AfterQuery

Computational Materials Science Researcher (Task Author)

Turn computational materials research you have run and debugged into evaluation tasks for AI models. You will build research-grade problems with connected subproblems, a Python reference solution, and tests. The role suits researchers at several career stages, from research-track bachelor’s students to recent graduates. You must qualify to work as an independent contractor without visa sponsorship; F-1 students, including those on OPT or CPT, cannot apply.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$100/hr
  • materials science
  • computational materials science
  • python
AI evaluationView job

Outlier · via Braintrust

Senior Systems & Hardware Experts - AI Benchmarking

Use your systems or hardware engineering experience to create difficult, clearly specified challenges for AI agents to solve in a Linux terminal. The project is task-based and expected to last a few weeks. Tasks average six to seven hours, with early submissions potentially taking longer. Earn up to $1,350 per task, with higher rates possible based on task quality and submission volume. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar.

Location and eligibility
Remote · Eligible in 25 countries
Engagement type
Contract
Compensation
$1,350 fixed
  • systems engineering
  • hardware engineering
  • linux
Hardware & Embedded SystemsView job

General Translation · via Mercor

Russian Linguistic Expert

Assess how well a large language model handles Russian, then help strengthen its language skills with carefully reviewed data. You will evaluate and refine text across translation, summarization, dialogue, and grammar correction, annotate linguistic features, and share findings with AI researchers on a project with a leading research lab.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • russian
  • english
  • translation
Language & LinguisticsView job

Handshake AI

Human Resources Professional

Use your human resources experience to help shape AI research through work on business communication, strategy, and corporate storytelling. Projects may ask you to create domain-specific prompts or assess LLM responses, drawing on expertise in materials such as board presentations, business cases, investor presentations, client proposals, and executive communications. Work remotely on a flexible schedule with no minimum hour commitment; project placement depends on availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $75/hr
  • human resources
  • business communication
  • business strategy
Human ResourcesView job

SME Careers

Mandarin Language Expert

Review and create Mandarin content for AI training, judging response quality, reasoning, and fidelity to the prompt. Apply China-specific localization expertise and MQM/LQA methods to identify language and factual issues, compare model answers, and write sound reference explanations. The work calls for native or near-native Mandarin, C1 or higher English, and at least five years of localization or translation experience.

Location and eligibility
Remote · Eligible in 21 countries
Engagement type
Contract
Compensation
Up to $40/hr
  • mandarin chinese
  • english
  • localization
Language & LinguisticsView job

micro1

General Cardiologist

In this remote, hourly independent-contractor role, you will apply cardiology and cardiac imaging expertise to AI training and evaluation. You will review generated interpretations, clinical reasoning, and recommendations across imaging cases. Applicants need English at B2 level or above. The selection process moves from application to an AI interview, domain-specific screening, and an onboarding call.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$80–$285/hr
  • cardiac imaging interpretation
  • echocardiography
  • cardiac mri
Health Informatics & Medical RecordsView job

Ethos

Policy Researcher / Think Tank Analyst

Help train a foundational AI lab’s language model by creating, assessing, and refining professional policy presentations. You’ll draw on experience producing policymaker-facing briefs and slides across policy briefings, data exhibits, testimony support, report launches, and stakeholder updates. The role is remote with a flexible schedule; task volume varies, and most experts work under 10 hours per week, with no weekly cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • policy research
  • think tank analysis
  • policy briefs
Data Science & AnalyticsView job

AfterQuery

Biology Experts

Help train and assess AI systems that answer questions about biological sciences. You may write challenging biology prompts, judge whether model responses use accurate facts and sound reasoning, catch issues such as invented citations or outdated nomenclature, draft reference answers with explanations, and build rubrics for scoring response quality.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$125/hr
  • biology
  • biological sciences
  • scientific writing
Science & ResearchView job

Outlier · via Braintrust

Senior Coding, ML & Security Experts - AI Benchmarking

Create difficult benchmark tasks from your professional experience in coding, machine learning, or cybersecurity. Each task must run in a Linux terminal and challenge advanced AI agents: three leading models get three attempts each, and they should fail most attempts. The project should run for the next few weeks. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar before tasking. Pay reaches $1,350 per task, with higher rates possible based on task quality and submission volume; tasks average six to seven hours, and your first tasks may take longer.

Location and eligibility
Remote · Eligible in 25 countries
Engagement type
Contract
Compensation
$1,350 fixed
  • coding
  • machine learning
  • cybersecurity
Machine Learning & AIView job

General Translation · via Mercor

Romanian Linguistic Expert

Assess how well a large language model handles Romanian across translation, summarization, dialogue, and grammar correction. You will also refine Romanian text, annotate linguistic features, and share detailed findings with AI researchers. The project focuses on improving the model’s Romanian data and language capabilities.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • romanian
  • english
  • linguistic annotation
Language & LinguisticsView job

Handshake AI

AI Evaluation Specialist (Canada)

Apply your academic knowledge to short-term projects that help improve large language models across different subjects. Handshake AI welcomes candidates from any discipline who live in Canada and hold Canadian work authorization. You’ll complete a brief training and one assessment before starting, then work remotely with no minimum hour commitment. Strong project results can qualify you for future assignments.

Location and eligibility
Remote · Canada only
Engagement type
Part-time
Compensation
$15/hr
  • large language models
  • ai evaluation
  • ai training
Machine Learning & AIView job

SME Careers

STEM & Technical Specialist – Rubric Design

Create advanced questions in your technical discipline, assess AI-generated solutions, and build scoring criteria that capture sound reasoning as well as correct results. The work centers on rubric design, partial-credit standards, and close review of technical details such as assumptions, formulas, units, and edge cases. Applicants need a relevant degree, at least three years of domain experience, and C1-level English.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $100/hr
  • ai evaluation
  • benchmarking
  • chemistry
Quality Assurance & TestingView job

micro1

Senior MBSE Engineer - SysML v2

As a contractor on an AI training and evaluation project, you’ll build SysML v2 reference models and assess model outputs for accuracy, traceability, and sound modeling practice. The remote, task-based engagement has variable hours, around 15 hours per week, and an expected pilot period of 4 weeks to 3 months. Applicants complete an AI interview.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$55–$120/hr
  • sysml v2
  • systems engineering
  • requirements engineering
Machine Learning & AIView job

Ethos

Expert Success Associate

At Ethos, you’ll handle support for experts whose work helps AI labs and other frontier clients build better models. You’ll own each case from the first message through resolution, work with internal teams, and review AI-drafted replies for accuracy and empathy. The role is based at the London office near King’s Cross, with in-person work Monday through Thursday and remote work on Friday.

Location and eligibility
Hybrid · United Kingdom only
Engagement type
Contract
Compensation
Pay not listed
  • customer support
  • customer success
  • case management
Customer SupportView job

Turing

Capital Markets Expert

Evaluate AI models on capital markets topics like pricing and structuring.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
$100/hr
  • capital markets
  • debt capital markets
  • equity capital markets
Machine Learning & AIView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.