AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Handshake AI

Energy Professional

Bring your energy-sector experience to project-based AI research. You’ll create expert training examples and assess AI responses for accuracy and relevance, drawing on the tools and workflows you use at work. The work runs remotely on a flexible, asynchronous schedule with no minimum hours; contributors often work 5–20 hours per week during active projects. Project access depends on current needs, with possible consideration for future work.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $80/hr
  • energy industry
  • oil and gas
  • power generation
Energy & Power GenerationView job

AfterQuery

ML Research Expert — Published First Author (Benchmark Authoring)

Create and validate research-grade benchmark tasks that test frontier AI models across machine learning. The role suits researchers with a master's or PhD, at least one first-author paper, and hands-on experience writing ML code for training, evaluation, or systems work. Work remotely on an asynchronous, flexible schedule of 5 to 40 hours per week, with hourly compensation of $150.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$150/hr
  • machine learning
  • language models
  • deep learning
Machine Learning & AIView job

Turing

Medicine Physician (MD/DO/Doctoral study/PhD)

Evaluate AI clinical reasoning with real medical scenarios and expertise.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • biology
  • clinical reasoning
  • clinical decision-making
Healthcare & MedicalView job

Mercor

Machine Learning Expert

Mercor keeps this listing open to build a pool of machine learning practitioners for AI training and evaluation projects. You may write problems from systems you have shipped, assess model-generated code, or spot approaches that could fail in production. Apply with your resume, confirm where you work from, and complete an AI interview that takes about 20 minutes. Project invitations can arrive within a week or several months.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70–$120/hr
  • machine learning
  • model training
  • model evaluation
Machine Learning & AIView job

Handshake AI

Estimator

Bring your energy project experience to AI research by creating expert training data and reviewing AI-generated responses. You’ll assess content about project development workflows, construction planning, solar design, and cost estimation, then share feedback on its accuracy and relevance. The work is remote and project-based, with flexible hours and no minimum-hour requirement. Active projects typically involve 5–20 hours per week.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • energy project estimation
  • pre-construction
  • solar design
Sales Engineering & Solutions ConsultingView job

AfterQuery

Real Estate Agent Expert

Create real estate questions and case studies for AI training, then assess model answers against practical standards and regulations. The work draws on an active real estate license and experience in practice, brokerage, or property management. You will also work with real estate and technical specialists to shape challenges that test topics such as valuation, contracts, financing, zoning, and market analysis.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • real estate
  • property valuation
  • contract negotiation
Machine Learning & AIView job

Mercor

Chemist Talent Network

Apply to Mercor’s Chemist Expert Network to be considered for future contract projects with AI labs and companies. After you complete your profile and pass an AI interview, Mercor may match you with projects as they open. Work can include chemistry model training and evaluation, real-world task creation, and expert feedback for AI research. Project commitments often range from 15 to 30 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$80/hr
  • analytical chemistry
  • laboratory experimentation
  • chemical data analysis
Machine Learning & AIView job

Handshake AI

Customer Ops Analyst

Use your energy industry experience to create expert training data and assess AI-generated responses about utility workflows and customer data management. The work draws on hands-on knowledge of utility metering, customer operations, and energy billing systems. Projects are remote and hourly, with flexible scheduling, no minimum hours, and about 5–20 hours per week during active projects. Placement depends on project needs; no prior AI experience is required.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • utility metering
  • customer operations
  • energy billing systems
Data Science & AnalyticsView job

AfterQuery

Attorney

AfterQuery seeks a JD-trained attorney to create and assess legal reasoning challenges for AI training modules. You will develop scenarios across areas such as contract law, constitutional law, and intellectual property, then review model answers for sound reasoning and proper use of legal principles. The role is remote, flexible, and asynchronous.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$138/hr
  • legal research
  • legal analysis
  • contract law
LegalView job

Turing

Full Stack Engineer

Create and evaluate code examples for training AI language models.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • c++
  • rust
Software EngineeringView job

Mercor

ML Challenge Task Auditor

Review applied machine-learning tasks that train and evaluate models at a frontier AI lab. You will judge experiment design, model-selection decisions, and evaluation methods, then write rubric-based feedback grounded in evidence. The work focuses on applied and experimental ML rigor, not building LLM applications or managing MLOps.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$90/hr
  • machine learning
  • experiment design
  • model selection
Machine Learning & AIView job

Handshake AI

Store Operation Manager

Use your retail management experience to create training examples and assess AI-generated answers about store operations. You’ll provide feedback on accuracy and relevance, drawing on practical knowledge of performance reporting, cash reconciliation, and inventory management. The work is remote, project-based, and part-time, with flexible scheduling and no minimum hours. Active projects typically involve 5–20 hours per week, and placement depends on project needs.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail store management
  • retail operations
  • store management workflows
Operations & ManagementView job

AfterQuery

Arcade/Gaming Experts

In this remote, project-based role, you will bring substantial gaming experience to annotation and evaluation work. You will review game content, data samples, and AI model outputs, then use your knowledge of games and the industry to judge their accuracy, quality, and relevance. The role also asks experts to create prompts for further game evaluation.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$20/hr
  • video games
  • arcade gaming
  • esports
Quality Assurance & TestingView job

Turing

MLE Bench – Data Analyst

Analyze ML datasets to evaluate and improve system performance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • machine learning
  • python
  • sql
Machine Learning & AIView job

Mercor

Physicist Talent Network

Apply to Mercor’s Physicist Expert Network for consideration for future contract projects with AI labs and companies. Complete your profile and pass an AI interview to qualify for project matching. Mercor connects experts with work as opportunities arise; projects vary in scope and duration, with typical commitments of 15–30 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$80/hr
  • physics
  • theoretical modeling
  • computational modeling
Machine Learning & AIView job

Handshake AI

Sociology Professor

Use your sociology experience to shape AI models through project-based work. You’ll create prompts grounded in your field, review model responses, and give structured feedback on sociology content and workplace language. The work is remote and asynchronous, with flexible hours and no minimum commitment. Most contributors average 5–20 hours. Project placement depends on availability, and opportunities open at intervals throughout the year.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$75/hr
  • sociology
  • prompt writing
  • ai response evaluation
Machine Learning & AIView job

AfterQuery

Linguistics Expert

AfterQuery’s expert data lab creates evaluation and training data for frontier AI labs. As a contract linguist, you’ll write scenarios that probe model reasoning in areas such as syntax, semantics, and phonology, then assess the accuracy of model analyses. The work runs remotely on an async schedule, with at least 10 hours of work each week and no set maximum.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • linguistics
  • syntax
  • semantics
Language & LinguisticsView job

Turing

LLM Java Developer

Develop and maintain Java code for training and optimizing AI models.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • java
  • large language models
  • llm training
Machine Learning & AIView job

Mercor

Physical Scientist Talent Network

Apply to join Mercor’s network for future projects with AI labs and other companies. After completing your profile and passing an AI interview, you may be matched with work based on your expertise and project needs. Projects cover AI training and evaluation in the physical sciences, with typical commitments of 15 to 30 hours per week and varying scope and duration.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$80/hr
  • physical sciences
  • experimental research
  • quantitative data analysis
Machine Learning & AIView job

Showing 20 active roles of 323. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.