AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Turing

AI Quality Analyst (Gemini) - Chinese

Evaluate Gemini's personalized Chinese responses for relevance and accuracy.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • chinese
  • gemini
  • prompt engineering
AI evaluationView job

AfterQuery

Property Manager Expert

Use your property management expertise to shape AI training content. You will write and assess questions and case studies on real-world operations, from tenant relations and maintenance to lease administration and housing compliance. Your feedback will help models produce answers grounded in established practices and legal standards.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$70/hr
  • property management
  • property operations
  • tenant relations
Machine Learning & AIView job

Mercor

Mathematics Domain Expert

Use your research expertise to assess mathematical reasoning in AI model outputs and shape the standards used to judge correctness. You will write rigorous problem specifications, reference solutions, and proofs, then build evaluation sets in your area of specialization. The role is fully remote and requires a United States base.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$90–$140/hr
  • mathematics
  • applied mathematics
  • statistics
Machine Learning & AIView job

Handshake AI

Portuguese AI Evaluation Specialist (Brazil)

Based in Brazil, you’ll assess AI-generated answers in Portuguese and explain which responses better serve individual users. The work draws on your real-world experience with AI tools and your ability to judge subtle differences between answers. You can complete these ongoing, project-based tasks remotely at your own pace, with no set schedule or minimum hours.

Location and eligibility
Remote · Brazil only
Engagement type
Part-time
Compensation
$25/hr
  • portuguese
  • english
  • ai response evaluation
AI evaluationView job

SME Careers

C# Team Lead

Guide quality across C# AI training projects by reviewing generated code and contributor work against project rubrics. You will assess correctness, runtime behavior, async patterns, security, tests, and clarity, then give actionable feedback and maintain contributor guidance. This remote contract has no immediate project assignment; qualified candidates may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $75/hr
  • c#
  • .net
  • asp.net core
Quality Assurance & TestingView job

Turing

Web Research Specialist

Design challenging research questions that AI cannot answer online.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$30/yr
  • llm evaluation
  • red-teaming
  • benchmark design
Market Research & InsightsView job

AfterQuery

Students Across All Disciplines (Masters/PhD)

Currently enrolled graduate students apply specialist knowledge to evaluate, write, and validate content for an AI evaluation research project. You can accept projects that fit your academic schedule and complete the work remotely on an asynchronous basis. The listing describes a commitment of 10–20 hours per week during a project window, while the source description estimates up to 10 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$100/hr
  • ai evaluation
  • content evaluation
  • annotation
Machine Learning & AIView job

Mercor

Biology & Life Sciences Domain Expert

Bring senior research expertise to the evaluation of AI systems in biology and the life sciences. You will assess scientific tasks and model responses, create precise problem specifications and reference solutions, and build research-level benchmarks in your specialty. The role suits a practicing specialist who can distinguish sound scientific reasoning from claims that only sound convincing.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$90–$140/hr
  • biology
  • life sciences
  • biochemistry
Science & ResearchView job

Handshake AI

Communication Professionals

Communication professionals with at least five years of experience in editing, news analysis, reporting, journalism, or writing can contribute to AI research projects. You’ll create industry-specific prompts and assess LLM responses to help AI better handle professional language and tasks. Work remotely on a flexible schedule with no minimum hours; project placement depends on availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • communication
  • editing
  • news analysis
Language & LinguisticsView job

SME Careers

Sociology Quality Assurance Lead (QAL)

Guide quality across sociology-focused AI training work by reviewing generated content and contributor submissions against project rubrics. You will assess sociological accuracy, research methods, bias, and ethical framing, then coach trainers and QAs through written feedback, onboarding, and documentation in tools such as Discord and Google Sheets. This is a contract role with no immediate project; qualified experts may be contacted when relevant work becomes available.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $65/hr
  • sociology
  • sociological theory
  • social research
Quality Assurance & TestingView job

Turing

Software Engineer – AI Research & Evaluation (US-based)

Create and evaluate datasets for training large language models in Python.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

AfterQuery

General AfterQuery Expert (Data Annotator)

Bring at least three years of expertise from a professional field to annotation work for text, documents, model outputs, and other domain-specific material. You will assess content with informed judgment, write structured annotations, and support decisions with reasoning and citations. The role offers flexible scheduling, project experience for your portfolio, and exposure to AI development workflows.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$43/hr
  • data annotation
  • content review
  • ai model evaluation
Data Science & AnalyticsView job

Mercor

Chemistry Domain Expert

Use senior-level chemistry expertise to assess how AI models handle research problems. You will review tasks and model responses, write problem specifications and reference solutions, and build research-level benchmarks in your specialty. The role suits a practicing specialist with a PhD, a senior research appointment or equivalent, and hands-on experience with large language models. Applicants must live in the United States; the work is remote.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$90–$140/hr
  • chemistry
  • chemical engineering
  • organic chemistry
Science & ResearchView job

Handshake AI

STEM Professors

Contribute STEM expertise to projects that improve large language models across mathematics, chemistry, biology, physics, and engineering. Fellows develop subject-specific prompts, assess model responses, and research topics of interest with AI support. Work takes place remotely on an asynchronous schedule, with an expected commitment of 10 to 20 hours per week. The year-round program assigns projects as availability permits, which varies by discipline.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $150/hr
  • mathematics
  • chemistry
  • biology
Machine Learning & AIView job

SME Careers

Bash Team Lead

Lead quality reviews for Bash and shell-scripting AI training work. You will assess scripts, CLI workflows, and technical explanations for correctness, portability, error handling, and safety, then guide trainers and reviewers with clear feedback. The role is remote and contract-based, with no immediate project; qualified candidates may be contacted when relevant work opens.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $65/hr
  • bash
  • shell scripting
  • linux
Cloud & DevOpsView job

Turing

Pulmonologist/Intensivist

Evaluate AI responses for accuracy in pulmonary and critical care medicine.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • pulmonary medicine
  • critical care medicine
  • pulmonology
Machine Learning & AIView job

AfterQuery

ML Research Engineer — Inference & GPU Kernels

AfterQuery is assembling senior experts in ML inference and GPU kernel engineering to assess how frontier AI models handle demanding technical problems. You will shape evaluation tasks and judge model responses using your own domain expertise. The work centers on research and evaluation, not production engineering, and covers inference serving, kernel optimization, and large-model deployment infrastructure.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • machine learning
  • artificial intelligence
  • ml inference
Machine Learning & AIView job

Mercor

Physics Domain Expert

Apply senior physics expertise to assess how AI models handle research-level reasoning. You will review model answers, write precise problems and reference solutions, and build evaluations in your area of specialization. The role suits an established researcher with a PhD, a strong publication record, hands-on experience with large language models, and a United States base.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$90–$140/hr
  • physics
  • astrophysics
  • applied physics
Machine Learning & AIView job

Handshake AI

CAD Tool Expert

Use your CAD expertise on an ongoing, project-based AI research effort. You’ll create tasks based on professional workflows such as 2D drafting, parametric 3D modeling, technical drawings, and design for fabrication, then assess AI responses and provide written feedback. Set your own pace with no fixed schedule or minimum hour requirement, and take on the work alongside your current role.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$125/hr
  • librecad
  • solvespace
  • openscad
EngineeringView job

SME Careers

Python Engineer

Review AI-generated Python code and technical explanations for correctness, design quality, performance, and fit to the prompt. You will also write reference solutions and clear technical explanations, then compare candidate responses by their reasoning and implementation. The role calls for substantial production experience with Python, strong software engineering fundamentals, and C1 proficiency in both English and Chinese.

Location and eligibility
Remote · Eligible in 21 countries
Engagement type
Contract
Compensation
Up to $60/hr
  • python
  • algorithms
  • data structures
Machine Learning & AIView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.