AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

SME Careers

Malay Quality Assurance Lead (QAL)

Lead quality reviews for Malay AI training work by checking generated content and contributor output against project rubrics. You will give trainers and QAs specific feedback, clarify language questions, and maintain guidance for regional usage, tone, and terminology. The role requires professional Malay language experience and strong English; no immediate project is available, but qualified candidates may be contacted for future work.

Location and eligibility
Remote · Malaysia only
Engagement type
Contract
Compensation
Up to $25/hr
  • bahasa melayu
  • malay
  • english
Language & LinguisticsView job

micro1

Member of Technical Staff, Robotics & Embodied AI Research

As a Member of Technical Staff, you will advance embodied AI and robot learning through hands-on research on VLA models, generalist policies, and world models. You will run experiments that draw on real-world data, simulation, and human-in-the-loop systems, then turn findings into solutions that can scale. The role is remote and calls for independent research ownership and close work with AI and robotics teams.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$20–$50/hr
  • Robot Learning & Embodied AI
  • Robotics Simulation & Sim-to-Real Transfer
  • Python & Robotics Research Engineering
Machine Learning & AIView job

Ethos

Training / Onboarding / L&D Specialist

Apply your learning and development experience to help train a foundational AI lab’s language model on professional documents, spreadsheets, and slide decks. You’ll create, assess, and refine materials for onboarding, facilitator training, curriculum planning, engagement tracking, manager enablement, and skills assessment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • learning and development
  • corporate training
  • onboarding
Machine Learning & AIView job

Turing

Business Analyst (Finnish Language)

Analyze content in Finnish and provide feedback to improve AI models.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • finnish
  • english
  • business analysis
Business Analysis & StrategyView job

AfterQuery

Computational Engineering Researcher (Task Author)

Turn engineering computations you have implemented and tested into research-grade tasks for AI model evaluation. Each task centers on a real calculation from your research, with a main problem, related subproblems, a Python reference solution, and tests. You can work around your own schedule, submit tasks for review, and choose whether to assess submissions from other experts.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$100/hr
  • python
  • finite element method
  • computational fluid dynamics
EngineeringView job

Turing · via Braintrust

Clinical Pharmacist - AI Evaluation

Create clinical pharmacy cases and evaluation standards for AI systems, then assess model responses for sound reasoning, documentation quality, and patient safety. The remote contract runs for 12 weeks, targets a November 2, 2026 start, and is open to US-based professionals. Choose 20 or 40 hours per week, with four hours of overlap with Pacific working hours. Selection includes an application review and assessment.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$38/hr
  • clinical pharmacy
  • medication reconciliation
  • medication safety
AI evaluationView job

Mercor

Clinical / Health Domain Expert

Bring clinical expertise to AI training work focused on medicine and health. You will shape training data, assess model responses, and help teams address gaps in clinical knowledge, patient communication, diagnosis, treatment, and guidelines. Cincinnatus LLC employs this part-time role on a W-2 basis and may place you with a leading AI lab. The role requires at least 20 weekday hours per week.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$90–$150/hr
  • clinical medicine
  • nursing
  • pharmacy
Healthcare & MedicalView job

Handshake AI

Korean AI Evaluation Specialist (South Korea)

Use your experience with ChatGPT and other AI chat assistants to help assess how well responses fit individual users. You’ll compare answers, explain your preferences in Korean, and submit feedback through Handshake’s annotation platform. The ongoing, project-based work has no set schedule or minimum hours, so you can fit tasks around your current role.

Location and eligibility
Remote · South Korea only
Engagement type
Part-time
Compensation
$30/hr
  • korean
  • english
  • chatgpt
AI evaluationView job

SME Careers

Legal Quality Assurance Lead (QAL)

Lead quality checks for legal AI training work by reviewing model responses and contributor submissions against project rubrics. You will guide trainers and QAs, flag legal reasoning and safety issues, and maintain resources such as calibration tasks and style guides. This remote contract has no immediate project; qualified candidates may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $120/hr
  • legal quality assurance
  • legal reasoning
  • legal research
Quality Assurance & TestingView job

micro1

Member of Technical Staff, Coding Agent Research & Evaluations

Shape how frontier coding agents are tested and improved. You will create evaluation methods, datasets, and tools, then study model performance across software engineering tasks. The work combines Python and software engineering, LLM and agent systems, benchmark design, and model failure analysis. You will also share research findings with technical and client audiences.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$8–$9/hr
  • Coding Agent Evaluation & Benchmark Design
  • Software Engineering & Python
  • LLM & Agentic Systems
Machine Learning & AIView job

Ethos

Management Consultant (Advisory & Transformation)

Help a leading foundational AI lab improve its language model’s presentation work. You’ll create, assess, and refine slide decks for consulting workflows, drawing on at least four years in a top consulting, strategy, or advisory practice. The role is remote and part-time, with hours shaped by client task volume and no guaranteed weekly hours; most experts work under 10 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$80/hr
  • management consulting
  • strategy consulting
  • advisory
Business Analysis & StrategyView job

Turing

Board Game Reasoning Expert (AI Training & Evaluation)

Create and evaluate board game tasks to enhance AI reasoning skills.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • board games
  • game design
  • game mechanics
Data Science & AnalyticsView job

AfterQuery

Enterprise Operations / Domain Analyst

AfterQuery is assembling senior experts in supply chain, finance, and compliance to assess how frontier AI models handle complex, real-world questions. You will shape the standards for correct, high-quality work by creating domain-specific problems, writing reference answers and rubrics, and judging model responses. The role centers on research and evaluation, not production engineering, and calls for 8–12 years of field experience and a bachelor's degree.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • supply chain
  • enterprise operations
  • finance
Enterprise Systems (ERP/CRM)View job

Turing · via Braintrust

Medical Coder / CDI Specialist - AI Evaluation

Use your medical coding or clinical documentation improvement expertise to build clinical cases and assess AI responses. The remote contract project is open to US-based professionals and runs for 12 weeks, with a target start date of November 2, 2026. Choose 20 or 40 hours per week, with four hours of overlap with Pacific working hours. Pay is $38 per hour; selection includes an application review and assessment.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$38/hr
  • medical coding
  • clinical documentation improvement
  • clinical reasoning
Health Informatics & Medical RecordsView job

Mercor

Regulatory Affairs Expert

Use your pharmaceutical or biotech regulatory expertise to shape AI training data and assess model performance. You will create realistic submission and health authority scenarios, review AI answers against FDA, EMA, and ICH standards, and help research and engineering teams address knowledge gaps. The role requires 40 hours per week on weekdays. Cincinnatus LLC employs you as a W-2 employee and may place you with a leading AI lab.

Location and eligibility
Remote · United States only
Engagement type
Full-time
Compensation
$70–$100/hr
  • regulatory affairs
  • regulatory strategy
  • ind
Developer RelationsView job

Handshake AI

Retail Operations Manager

Use your retail operations experience on ongoing, project-based AI research work. You’ll write training questions grounded in store workflows, assess AI responses about store performance and inventory, and give structured feedback. Work remotely at your own pace, with no set schedule or minimum hour requirement, alongside your current work.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail operations management
  • store performance reporting
  • cash reconciliation
Operations & ManagementView job

SME Careers

HTML/CSS Team Lead

Guide quality across HTML/CSS AI training work by reviewing generated code and contributor evaluations against project rubrics. You will assess semantics, accessibility, responsive behavior, browser support, and CSS structure, then give actionable feedback and maintain resources for remote contributors. The role requires at least three years of relevant frontend experience and strong English communication.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $80/hr
  • html
  • css
  • web accessibility
Quality Assurance & TestingView job

micro1

Member of Technical Staff, Cortex Lab (applied AI research)

Develop and assess LLM-powered agents and AI systems used in enterprise workflows. The role combines applied research with hands-on engineering: you will design evaluations, investigate failures, run experiments, and help improve system performance. You will also build research tools and infrastructure while working with researchers, engineers, domain experts, and enterprise customers.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$100–$130/hr
  • AI Agent Evaluation & Benchmark Design
  • Python & Research Engineering
  • Agent Failure Analysis & Experimentation
Machine Learning & AIView job

Ethos

Personal Finance / Consumer Planning Advisor

Help train a language model from a leading foundational AI lab by creating, reviewing, and refining financial documents, spreadsheets, and slide decks. Work across household cash-flow plans, goals-based financial plans, retirement drawdown models, debt payoff schedules, net-worth statements, and risk-tolerance questionnaires. The role is fully remote, with hours tied to client task volume; most experts work under 10 hours per week, with no weekly cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • personal finance
  • consumer planning
  • household cash-flow planning
Finance & AccountingView job

Turing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.