AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

SME Careers

HTML/CSS Team Lead

Guide quality across HTML/CSS AI training work by reviewing generated code and contributor evaluations against project rubrics. You will assess semantics, accessibility, responsive behavior, browser support, and CSS structure, then give actionable feedback and maintain resources for remote contributors. The role requires at least three years of relevant frontend experience and strong English communication.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $80/hr
  • html
  • css
  • web accessibility
Quality Assurance & TestingView job

AfterQuery

Full-Stack Software Engineer - Testing & Evaluation

Build substantial software projects that mirror real engineering work. You’ll shape multi-file codebases, create development challenges with clear documentation, and write deterministic tests that verify correct, repeatable results. The role calls for full-stack experience, strong technical writing, and hands-on use of Docker or a similar container tool.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • javascript
  • typescript
  • java
Software EngineeringView job

Turing

AI Benchmark & Red-Teaming Specialist

Research and build benchmark tasks to expose AI model weaknesses.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • large language models
  • ai benchmarking
  • red teaming
Machine Learning & AIView job

SME Careers

Chemistry Quality Assurance Lead (QAL)

Guide quality across chemistry AI training projects by reviewing generated explanations, calculations, reaction logic, and contributor work against project rubrics. You will coach trainers and QAs, resolve chemistry questions, maintain project guidance, and flag safety risks. The role calls for a relevant science degree, at least three years of related experience, and clear English communication.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $75/hr
  • chemistry
  • chemical reasoning
  • chemistry quality assurance
Quality Assurance & TestingView job

AfterQuery

Mechanical / Hardware Design Engineer

Join a research cohort of senior experts who assess how frontier AI models handle complex, real-world problems in hardware design, including CAD, RTL, and robotics. You will define standards for correct, high-quality work through scenario design, reference solutions, rubrics, and model-output reviews. The role centers on research and evaluation, not production engineering. The process includes a thorough background check.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • mechanical design
  • hardware design
  • cad
Hardware & Embedded SystemsView job

SME Careers

Medical Quality Assurance Lead (QAL)

Lead medical quality reviews across AI training projects by checking clinical content and contributor work against project rubrics. You will flag patient-safety risks, give trainers and QAs actionable feedback, and maintain review guidance and calibration materials. The role uses LLM evaluation, Discord, and Google Sheets. No project is active now; qualified experts may be contacted for future work. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $95/hr
  • medical quality assurance
  • medical review
  • clinical reasoning
Quality Assurance & TestingView job

AfterQuery

Arcade/Gaming Experts

In this remote, project-based role, you will bring substantial gaming experience to annotation and evaluation work. You will review game content, data samples, and AI model outputs, then use your knowledge of games and the industry to judge their accuracy, quality, and relevance. The role also asks experts to create prompts for further game evaluation.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$20/hr
  • video games
  • arcade gaming
  • esports
Quality Assurance & TestingView job

Turing

Full Stack Engineer

Create and evaluate code examples for training AI language models.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • c++
  • rust
Software EngineeringView job

SME Careers

Estonian Team Lead

Lead quality checks for Estonian AI training projects by reviewing generated content and contributor work against project rubrics. You will coach trainers and QA reviewers, resolve language questions, and keep Estonian style guides and quality records current. The role calls for strong written Estonian and English, plus experience with language-review workflows.

Location and eligibility
Remote · Estonia only
Engagement type
Contract
Compensation
Up to $40/hr
  • estonian
  • english
  • estonian grammar
Language & LinguisticsView job

SME Careers

C Team Lead

Lead quality checks for C programming work used in AI training projects. You will review generated code and contributor evaluations for correctness, compilation, memory safety, portability, and clear technical explanations, then coach contributors and maintain QA resources. This is a remote contract opportunity with no immediate project; qualified candidates may be contacted when relevant work becomes available.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $75/hr
  • c
  • c programming
  • code review
Quality Assurance & TestingView job

SME Careers

R Team Lead

Lead quality checks for R programming and data-analysis work used in AI training projects. You will assess generated code, statistical explanations, charts, and trainer reviews against project rubrics, then give specific feedback and maintain guidance for contributors. The role is a remote contract with no immediate project; qualified experts may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $65/hr
  • r
  • tidyverse
  • base r
Quality Assurance & TestingView job

SME Careers

Polish Team Lead

Lead quality workflows for Polish AI training projects by reviewing Polish-language content and contributor work against project rubrics. You will give trainers and QAs specific feedback, address language and localization questions, and keep style guides and quality records current. The role calls for strong Polish and English, plus experience in language review; selection includes an AI interview, a domain-specific task, and a recruiter interview.

Location and eligibility
Remote · Poland only
Engagement type
Contract
Compensation
Up to $35/hr
  • polish
  • english
  • polish grammar
Language & LinguisticsView job

SME Careers

Physics Quality Assurance Lead (QAL)

Guide quality checks for physics AI training by reviewing generated explanations, calculations, diagrams, and contributor work against project rubrics. You will give specific feedback, answer physics and workflow questions, maintain contributor resources, and address recurring quality gaps. The role is remote and contract-based, requires native Punjabi fluency, and includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · India, United States
Engagement type
Contract
Compensation
Up to $75/hr
  • physics
  • classical mechanics
  • electromagnetism
Quality Assurance & TestingView job

SME Careers

Philosophy Quality Assurance Lead (QAL)

As a remote contract lead, you will review philosophy-focused AI outputs and contributor work for logical validity, conceptual precision, sound interpretation, and rubric compliance. You will coach trainers and QAs, keep review guidance current, and address recurring quality gaps. The role calls for a relevant degree, at least three years of related experience, and clear written English.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $65/hr
  • philosophy
  • argument analysis
  • logic
Quality Assurance & TestingView job

SME Careers

R Engineer

Review AI-generated answers to R and data analysis questions, checking statistical reasoning, code, and results against each prompt. You will also write model solutions and explanations that show sound analytical practice. The role requires at least two years of R experience and C1 English proficiency. No project is active now; qualified experts may be contacted when matching work becomes available.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $55/hr
  • r
  • data analysis
  • data cleaning
Data Science & AnalyticsView job

SME Careers

Russian Team Lead

Guide quality across Russian-language AI training projects by reviewing generated content and contributor work against project rubrics. You will give trainers and QA reviewers actionable feedback, answer language questions, lead onboarding, and maintain Russian style guides and quality records. The role calls for native or near-native Russian, strong English, and at least three years of relevant language or review experience.

Location and eligibility
Remote · Eligible in 11 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • russian
  • english
  • russian grammar
Language & LinguisticsView job

SME Careers

Chemical Engineer Quality Assurance Lead (QAL)

Review chemical engineering AI outputs and contributor work against technical rubrics, with attention to calculations, units, clarity, and process safety. You will guide trainer and QA workflows, share actionable feedback, run onboarding, and maintain project references such as style guides and calibration tasks. The role calls for a chemical engineering background and at least three years of relevant professional experience.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $105/hr
  • chemical engineering
  • process engineering
  • quality assurance
Quality Assurance & TestingView job

SME Careers

C# Team Lead

Guide quality across C# AI training projects by reviewing generated code and contributor work against project rubrics. You will assess correctness, runtime behavior, async patterns, security, tests, and clarity, then give actionable feedback and maintain contributor guidance. This remote contract has no immediate project assignment; qualified candidates may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $75/hr
  • c#
  • .net
  • asp.net core
Quality Assurance & TestingView job

SME Careers

Sociology Quality Assurance Lead (QAL)

Guide quality across sociology-focused AI training work by reviewing generated content and contributor submissions against project rubrics. You will assess sociological accuracy, research methods, bias, and ethical framing, then coach trainers and QAs through written feedback, onboarding, and documentation in tools such as Discord and Google Sheets. This is a contract role with no immediate project; qualified experts may be contacted when relevant work becomes available.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $65/hr
  • sociology
  • sociological theory
  • social research
Quality Assurance & TestingView job

Showing 20 active roles of 113. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.