AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Turing

Domain Expert- Politics

Evaluate and improve AI responses in political science and governance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • political science
  • governance
  • elections
Machine Learning & AIView job

AfterQuery

Full-Stack Software Engineer - Testing & Evaluation

Build substantial software projects that mirror real engineering work. You’ll shape multi-file codebases, create development challenges with clear documentation, and write deterministic tests that verify correct, repeatable results. The role calls for full-stack experience, strong technical writing, and hands-on use of Docker or a similar container tool.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • javascript
  • typescript
  • java
Software EngineeringView job

Mercor

Chemist Talent Network

Apply to Mercor’s Chemist Expert Network to be considered for future contract projects with AI labs and companies. After you complete your profile and pass an AI interview, Mercor may match you with projects as they open. Work can include chemistry model training and evaluation, real-world task creation, and expert feedback for AI research. Project commitments often range from 15 to 30 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$80/hr
  • analytical chemistry
  • laboratory experimentation
  • chemical data analysis
Machine Learning & AIView job

Handshake AI

Sociology Professor

Use your sociology experience to shape AI models through project-based work. You’ll create prompts grounded in your field, review model responses, and give structured feedback on sociology content and workplace language. The work is remote and asynchronous, with flexible hours and no minimum commitment. Most contributors average 5–20 hours. Project placement depends on availability, and opportunities open at intervals throughout the year.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$75/hr
  • sociology
  • prompt writing
  • ai response evaluation
Machine Learning & AIView job

SME Careers

Social Sciences & Education Team Lead

Lead quality review across social science, education, and learning-focused AI training projects. You will assess AI-generated explanations and educational materials against project rubrics, coach trainers and QA contributors, and address recurring quality gaps. The work calls for expertise in social science or education, precise written feedback, and comfort coordinating remote workflows through Discord, Google Docs, and Google Sheets.

Location and eligibility
Remote · India only
Engagement type
Contract
Compensation
Up to $20/hr
  • ai training
  • curriculum review
  • education
Education & TrainingView job

Turing

Business Analyst - US Educational Raters - Gemini

Research and evaluate AI responses to enhance model accuracy.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$30/hr
  • research
  • information verification
  • analytical reasoning
Business Analysis & StrategyView job

AfterQuery

Mechanical / Hardware Design Engineer

Join a research cohort of senior experts who assess how frontier AI models handle complex, real-world problems in hardware design, including CAD, RTL, and robotics. You will define standards for correct, high-quality work through scenario design, reference solutions, rubrics, and model-output reviews. The role centers on research and evaluation, not production engineering. The process includes a thorough background check.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • mechanical design
  • hardware design
  • cad
Hardware & Embedded SystemsView job

Mercor

ML Challenge Task Auditor

Review applied machine-learning tasks that train and evaluate models at a frontier AI lab. You will judge experiment design, model-selection decisions, and evaluation methods, then write rubric-based feedback grounded in evidence. The work focuses on applied and experimental ML rigor, not building LLM applications or managing MLOps.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$90/hr
  • machine learning
  • experiment design
  • model selection
Machine Learning & AIView job

Handshake AI

Procurement & Contracts Manager

Use your procurement, contracts, or construction sourcing experience to assess AI-generated content and help models reflect real-world workflows. You’ll write training questions and scenarios, review model responses, and provide structured feedback. The ongoing, project-based work is part-time, remote, and self-scheduled, with no set hours or minimum hour requirement.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • procurement
  • contract management
  • construction sourcing
Talent Acquisition & RecruitingView job

SME Careers

Portuguese Quality Assurance Lead (QAL)

As a remote contractor, you will review Portuguese AI-training content and contributor work against project rubrics, with a focus on Brazil-specific language quality. You will give trainers and quality reviewers actionable feedback, resolve questions about grammar and cultural context, and maintain resources such as Portuguese style guides and Google Sheets trackers. This role has no immediate project; qualified candidates may be contacted when relevant work becomes available.

Location and eligibility
Remote · Brazil, Portugal
Engagement type
Contract
Compensation
Up to $35/hr
  • portuguese
  • english
  • localization qa
Language & LinguisticsView job

Turing

Resident Medical Specialist (MD/DO)

Design evaluation methods to enhance AI clinical reasoning in real scenarios.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • clinical reasoning
  • clinical decision-making
  • evidence-based medicine
Healthcare & MedicalView job

AfterQuery

Computational Chemistry Researcher (Task Author)

Turn computational work from your chemistry research into evaluation tasks for AI models. You will build each task around work you have run and debugged, with connected subproblems, a Python reference solution, and tests. The role suits researchers across fields such as electronic structure, kinetics, spectroscopy, catalysis, and chemical thermodynamics. Work follows a flexible, task-based schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$100/hr
  • computational chemistry
  • python
  • chemical kinetics
Science & ResearchView job

Mercor

Physicist Talent Network

Apply to Mercor’s Physicist Expert Network for consideration for future contract projects with AI labs and companies. Complete your profile and pass an AI interview to qualify for project matching. Mercor connects experts with work as opportunities arise; projects vary in scope and duration, with typical commitments of 15–30 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$80/hr
  • physics
  • theoretical modeling
  • computational modeling
Machine Learning & AIView job

Handshake AI

Solar Design Engineer

Use your energy industry experience to create training examples and assess AI responses about project development and cost estimation. The work draws on hands-on knowledge of estimation, pre-construction, or solar design tools. Projects are remote and project-based, with a flexible schedule, no minimum hours, and a typical commitment of about 5–20 hours per week during active projects. Placement depends on project needs, with future projects also possible.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • energy project estimation
  • pre-construction
  • solar design
Sales Engineering & Solutions ConsultingView job

SME Careers

School Science (Elementary) Team Lead

Guide quality across elementary science AI training projects by reviewing learner-facing explanations, activities, worksheets, quizzes, and contributor work. You will assess scientific accuracy, grade-level fit, clarity, and safety, then coach trainers and QA reviewers through written feedback, onboarding, and project guidance. The role calls for elementary science expertise, strong English communication, and native Punjabi fluency.

Location and eligibility
Remote · India only
Engagement type
Contract
Compensation
Up to $10/hr
  • elementary science
  • science education
  • stem education
Education & TrainingView job

Turing

Medicine Physician (MD/DO/Doctoral study/PhD)

Evaluate AI clinical reasoning with real medical scenarios and expertise.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • biology
  • clinical reasoning
  • clinical decision-making
Healthcare & MedicalView job

AfterQuery

Arcade/Gaming Experts

In this remote, project-based role, you will bring substantial gaming experience to annotation and evaluation work. You will review game content, data samples, and AI model outputs, then use your knowledge of games and the industry to judge their accuracy, quality, and relevance. The role also asks experts to create prompts for further game evaluation.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$20/hr
  • video games
  • arcade gaming
  • esports
Quality Assurance & TestingView job

Mercor

Physical Scientist Talent Network

Apply to join Mercor’s network for future projects with AI labs and other companies. After completing your profile and passing an AI interview, you may be matched with work based on your expertise and project needs. Projects cover AI training and evaluation in the physical sciences, with typical commitments of 15 to 30 hours per week and varying scope and duration.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$80/hr
  • physical sciences
  • experimental research
  • quantitative data analysis
Machine Learning & AIView job

Handshake AI

Math Expert

Use your advanced mathematics training in flexible, hourly, project-based work supporting AI research. You’ll write rigorous questions and assess AI answers for accuracy, logical consistency, and mathematical rigor, with a focus on mathematical reasoning, proofs, and technical problem-solving. Work takes place remotely on an asynchronous schedule, with no minimum hours; contributors often work about 5–20 hours a week during active projects. Placement depends on project needs.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $75/hr
  • mathematics
  • advanced mathematical reasoning
  • proof-writing
Machine Learning & AIView job

SME Careers

Python Team Lead

Lead quality reviews for Python work across AI training projects, checking generated code and contributor submissions against project rubrics. You will give specific feedback, support trainer onboarding, and maintain QA resources; strong knowledge of Python and pytest helps you assess correctness, security, performance, and testing. This is a remote contract role with no immediate project assignment, though qualified candidates may be contacted as relevant work opens.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $70/hr
  • python
  • python qa
  • code review
Quality Assurance & TestingView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.