AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

AfterQuery

Machine Learning / Data Science Expert

Work on project-based data science and machine learning tasks similar to those found in analytics, AI research, and machine learning engineering. Projects run over the next 2–3 weeks, with asynchronous work and an expected commitment of 10–20 hours per week for each project you accept. You’ll help develop and assess models for business applications.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$80/hr
  • machine learning
  • data science
  • predictive modeling
Machine Learning & AIView job

Turing

Capital Markets Expert

Evaluate AI models on capital markets topics like pricing and structuring.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
$100/hr
  • capital markets
  • debt capital markets
  • equity capital markets
Machine Learning & AIView job

General Translation · via Mercor

Russian Linguistic Expert

Assess how well a large language model handles Russian, then help strengthen its language skills with carefully reviewed data. You will evaluate and refine text across translation, summarization, dialogue, and grammar correction, annotate linguistic features, and share findings with AI researchers on a project with a leading research lab.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • russian
  • english
  • translation
Language & LinguisticsView job

Handshake AI

Retail Operations Manager

Use your retail operations experience on ongoing, project-based AI research work. You’ll write training questions grounded in store workflows, assess AI responses about store performance and inventory, and give structured feedback. Work remotely at your own pace, with no set schedule or minimum hour requirement, alongside your current work.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail operations management
  • store performance reporting
  • cash reconciliation
Operations & ManagementView job

SME Careers

Computer Science & IT Team Lead

Lead quality checks for computer science and IT AI training work, reviewing technical answers, code, and troubleshooting guidance against project rubrics. You will coach trainers and QA contributors, document standards, and flag inaccurate or unsafe recommendations. The role calls for at least three years of relevant technical experience, strong English communication, and native Punjabi fluency.

Location and eligibility
Remote · India only
Engagement type
Contract
Compensation
Up to $20/hr
  • computer science
  • information technology
  • software engineering
Quality Assurance & TestingView job

micro1

Member of Technical Staff, Coding Agent Research & Evaluations

Shape how frontier coding agents are tested and improved. You will create evaluation methods, datasets, and tools, then study model performance across software engineering tasks. The work combines Python and software engineering, LLM and agent systems, benchmark design, and model failure analysis. You will also share research findings with technical and client audiences.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$8–$9/hr
  • Coding Agent Evaluation & Benchmark Design
  • Software Engineering & Python
  • LLM & Agentic Systems
Machine Learning & AIView job

Ethos

Real Estate / Hospitality / Events Professional

Create, assess, and refine documents, spreadsheets, and slide decks that help train a foundational AI model. Work across real estate, hospitality, and events workflows, including property listings, lease summaries, event schedules, venue proposals, guest service standards, and banquet orders. The role is fully remote, with a flexible schedule and task volume that varies. Most experts work under 10 hours per week, with no weekly cap; work can start as soon as possible.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • real estate transactions
  • hospitality operations
  • event production
Machine Learning & AIView job

AfterQuery

Medical Expert

Medical experts help train and assess AI systems that handle clinical and healthcare questions. The work can include creating challenging prompts, checking answers for accuracy and sound medical reasoning, and catching errors in lab interpretation or differential diagnoses. Topics span diagnosis, treatment planning, pharmacology, patient safety, and nursing care.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$125/hr
  • clinical diagnosis
  • treatment planning
  • pharmacology
Healthcare & MedicalView job

Turing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

General Translation · via Mercor

Armenian Linguistic Expert

Assess how well a large language model handles Armenian across translation, summarization, dialogue, and grammar correction. You will refine Armenian text, annotate linguistic features, and share analysis that helps AI researchers address language gaps and improve model training. The work calls for expert knowledge of Armenian grammar, style, regional variation, and cultural context.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • armenian
  • english
  • linguistic annotation
Language & LinguisticsView job

Handshake AI

Environmental Science Professional

Apply your environmental science expertise to an AI research project focused on how models interpret professional work and language. Project assignments may involve writing industry-specific prompts and assessing large language model responses. The program runs year-round, with projects opening at intervals; placement depends on available work. Contributors work remotely on a flexible schedule with no minimum hour commitment.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • environmental science
  • conservation science
  • environmental health
Science & ResearchView job

SME Careers

Tamil Expert with Mathematical Background

Use your Tamil language expertise and mathematics degree to shape AI training content and assess model responses. You will write prompts and reference answers, compare outputs for accuracy, fluency, tone, and cultural fit, and explain language or reasoning issues in English. The role requires native or near-native written Tamil, C1 English, and at least three years of relevant professional experience.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $15/hr
  • tamil
  • english
  • mathematics
Language & LinguisticsView job

micro1

Member of Technical Staff, Cortex Lab (applied AI research)

Develop and assess LLM-powered agents and AI systems used in enterprise workflows. The role combines applied research with hands-on engineering: you will design evaluations, investigate failures, run experiments, and help improve system performance. You will also build research tools and infrastructure while working with researchers, engineers, domain experts, and enterprise customers.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$100–$130/hr
  • AI Agent Evaluation & Benchmark Design
  • Python & Research Engineering
  • Agent Failure Analysis & Experimentation
Machine Learning & AIView job

Ethos

Policy Researcher / Think Tank Analyst

Help train a foundational AI lab’s language model by creating, assessing, and refining professional policy presentations. You’ll draw on experience producing policymaker-facing briefs and slides across policy briefings, data exhibits, testimony support, report launches, and stakeholder updates. The role is remote with a flexible schedule; task volume varies, and most experts work under 10 hours per week, with no weekly cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • policy research
  • think tank analysis
  • policy briefs
Data Science & AnalyticsView job

AfterQuery

Computational Engineering Researcher (Task Author)

Turn engineering computations you have implemented and tested into research-grade tasks for AI model evaluation. Each task centers on a real calculation from your research, with a main problem, related subproblems, a Python reference solution, and tests. You can work around your own schedule, submit tasks for review, and choose whether to assess submissions from other experts.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$100/hr
  • python
  • finite element method
  • computational fluid dynamics
EngineeringView job

Turing

Employment & Labor Law Expert

Evaluate AI responses to U.S. employment law scenarios for accuracy.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • employment law
  • labor relations
  • workplace compliance
LegalView job

General Translation · via Mercor

Japanese Linguistic Expert

Assess how well an LLM handles Japanese across translation, summaries, dialogue, and grammar correction. You will also edit and annotate Japanese text, flag language and cultural issues, and share detailed feedback with AI researchers. The work calls for native or near-native Japanese fluency, professional English, and experience with Japanese language work such as translation, editing, or annotation.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • japanese
  • english
  • translation
Language & LinguisticsView job

Handshake AI

Biology Expert

Use your biology expertise on remote, project-based work that helps improve AI responses. You’ll create questions grounded in the field and assess model answers for accuracy, scientific reasoning, experimental design, and technical problem-solving. The schedule is flexible, with no minimum hours; contributors often work about 5–20 hours per week during active projects. Project placement depends on current needs, with future projects also possible.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$125/hr
  • biology
  • experimental design
  • experimental methodology
Science & ResearchView job

SME Careers

Data Scientist

Review AI-generated data science reasoning, code, and model results, then create reference solutions that show sound quantitative methods. You will check statistical claims, modeling decisions, and prompt compliance, and compare answers for correctness and clarity. The work draws on Python, scikit-learn, and SQL expertise. This contract has no immediate project; qualified candidates may hear about future assignments.

Location and eligibility
Remote · Germany, India, United States
Engagement type
Contract
Compensation
Up to $100/hr
  • data science
  • python
  • pandas
Data Science & AnalyticsView job

micro1

Member of Technical Staff, Realm Lab (frontier AI research)

Realm Lab needs a Member of Technical Staff to evaluate and improve frontier AI systems. You’ll work across machine learning, data research, and evaluation engineering, building benchmarks, reinforcement learning environments, and datasets. The role calls for hands-on experience with LLM evaluation, Python, and experimental methods, plus the ability to turn real-world workflows into structured tests of model capabilities.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$100–$130/hr
  • LLM Evaluation & Benchmark Design
  • Python & ML Engineering
  • Reinforcement Learning & Agentic Systems
Machine Learning & AIView job

Showing 20 active roles of 323. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.