AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Handshake AI

Store Manager

Use your retail store management experience on flexible, project-based AI research work. You’ll create training questions and scenarios, assess AI responses against real store practices, and write feedback to help improve model performance. The work is part-time and contract-based, with no set schedule or minimum hour requirement, so you can complete tasks at your own pace alongside your current work.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail store management
  • store operations
  • store performance reporting
Machine Learning & AIView job

AfterQuery

Property Manager Expert

Use your property management expertise to shape AI training content. You will write and assess questions and case studies on real-world operations, from tenant relations and maintenance to lease administration and housing compliance. Your feedback will help models produce answers grounded in established practices and legal standards.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$70/hr
  • property management
  • property operations
  • tenant relations
Machine Learning & AIView job

Turing

AI Benchmark & Red-Teaming Specialist

Research and build benchmark tasks to expose AI model weaknesses.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • large language models
  • ai benchmarking
  • red teaming
Machine Learning & AIView job

Mercor

Mathematics Domain Expert

Use your research expertise to assess mathematical reasoning in AI model outputs and shape the standards used to judge correctness. You will write rigorous problem specifications, reference solutions, and proofs, then build evaluation sets in your area of specialization. The role is fully remote and requires a United States base.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$90–$140/hr
  • mathematics
  • applied mathematics
  • statistics
Machine Learning & AIView job

Handshake AI

Renewable Energy Engineer

Apply your renewable energy or microgrid engineering experience to project-based AI research. You’ll write training questions grounded in real workflows, assess AI responses about renewable energy modeling and design, and submit written feedback. Work at your own pace with no set schedule or minimum hour requirement, alongside your current work.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • renewable energy engineering
  • microgrid design
  • asset performance
Energy & Power GenerationView job

AfterQuery

Students Across All Disciplines (Masters/PhD)

Currently enrolled graduate students apply specialist knowledge to evaluate, write, and validate content for an AI evaluation research project. You can accept projects that fit your academic schedule and complete the work remotely on an asynchronous basis. The listing describes a commitment of 10–20 hours per week during a project window, while the source description estimates up to 10 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$100/hr
  • ai evaluation
  • content evaluation
  • annotation
Machine Learning & AIView job

Turing

Senior Software Engineer - AI Evaluation / Coding Agents

Evaluate and improve AI coding models by reviewing generated code.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$100–$150/hr
  • python
  • typescript
  • javascript
Machine Learning & AIView job

Mercor

Biology & Life Sciences Domain Expert

Bring senior research expertise to the evaluation of AI systems in biology and the life sciences. You will assess scientific tasks and model responses, create precise problem specifications and reference solutions, and build research-level benchmarks in your specialty. The role suits a practicing specialist who can distinguish sound scientific reasoning from claims that only sound convincing.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$90–$140/hr
  • biology
  • life sciences
  • biochemistry
Science & ResearchView job

Handshake AI

Communication Professionals

Communication professionals with at least five years of experience in editing, news analysis, reporting, journalism, or writing can contribute to AI research projects. You’ll create industry-specific prompts and assess LLM responses to help AI better handle professional language and tasks. Work remotely on a flexible schedule with no minimum hours; project placement depends on availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • communication
  • editing
  • news analysis
Language & LinguisticsView job

AfterQuery

General AfterQuery Expert (Data Annotator)

Bring at least three years of expertise from a professional field to annotation work for text, documents, model outputs, and other domain-specific material. You will assess content with informed judgment, write structured annotations, and support decisions with reasoning and citations. The role offers flexible scheduling, project experience for your portfolio, and exposure to AI development workflows.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$43/hr
  • data annotation
  • content review
  • ai model evaluation
Data Science & AnalyticsView job

Turing

Equity Research Analyst

Evaluate AI models using financial analysis and investment strategies.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
$100/hr
  • equity research
  • credit research
  • financial statement analysis
Machine Learning & AIView job

Mercor

Physics Domain Expert

Apply senior physics expertise to assess how AI models handle research-level reasoning. You will review model answers, write precise problems and reference solutions, and build evaluations in your area of specialization. The role suits an established researcher with a PhD, a strong publication record, hands-on experience with large language models, and a United States base.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$90–$140/hr
  • physics
  • astrophysics
  • applied physics
Machine Learning & AIView job

Handshake AI

STEM Professors

Contribute STEM expertise to projects that improve large language models across mathematics, chemistry, biology, physics, and engineering. Fellows develop subject-specific prompts, assess model responses, and research topics of interest with AI support. Work takes place remotely on an asynchronous schedule, with an expected commitment of 10 to 20 hours per week. The year-round program assigns projects as availability permits, which varies by discipline.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $150/hr
  • mathematics
  • chemistry
  • biology
Machine Learning & AIView job

AfterQuery

ML Research Engineer — Inference & GPU Kernels

AfterQuery is assembling senior experts in ML inference and GPU kernel engineering to assess how frontier AI models handle demanding technical problems. You will shape evaluation tasks and judge model responses using your own domain expertise. The work centers on research and evaluation, not production engineering, and covers inference serving, kernel optimization, and large-model deployment infrastructure.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • machine learning
  • artificial intelligence
  • ml inference
Machine Learning & AIView job

Turing

Domain Expert- Politics

Evaluate and improve AI responses in political science and governance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • political science
  • governance
  • elections
Machine Learning & AIView job

Mercor

Education & Training Expert

Mercor maintains an ongoing pool of educators for AI training and evaluation projects, rather than hiring for one active opening. Work can include creating teaching problems and reference answers, assessing model-generated lessons and explanations, and spotting content that may confuse learners. Apply with a resume, confirm where you work from, and complete an AI interview of about 20 minutes. Project invitations may arrive within a week or several months.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$30–$85/hr
  • education
  • teaching
  • tutoring
Education & TrainingView job

Handshake AI

CAD Tool Expert

Use your CAD expertise on an ongoing, project-based AI research effort. You’ll create tasks based on professional workflows such as 2D drafting, parametric 3D modeling, technical drawings, and design for fabrication, then assess AI responses and provide written feedback. Set your own pace with no fixed schedule or minimum hour requirement, and take on the work alongside your current role.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$125/hr
  • librecad
  • solvespace
  • openscad
EngineeringView job

AfterQuery

Compliance Officer Expert

Create and assess regulatory compliance challenges that help train AI models. You will write scenarios on topics such as regulatory interpretation, risk assessment, audits, investigations, and ethics, then review model answers for accuracy and alignment with compliance standards. The work draws on practical compliance expertise and takes place remotely with a flexible, asynchronous schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • regulatory compliance
  • regulatory frameworks
  • risk assessment
Machine Learning & AIView job

Turing

Resident Medical Specialist (MD/DO)

Design evaluation methods to enhance AI clinical reasoning in real scenarios.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • clinical reasoning
  • clinical decision-making
  • evidence-based medicine
Healthcare & MedicalView job

Mercor

Legal Expert

Mercor maintains a standing pool of legal professionals for AI training and evaluation projects. Depending on the project, you may write legal scenarios with reference answers or assess model-generated legal work for accuracy and context. Apply with your resume, confirm where you work from, and complete an AI interview of about 20 minutes. Mercor contacts candidates when a project matches their background.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$150/hr
  • legal practice
  • criminal justice
  • litigation
LegalView job

Showing 20 active roles of 323. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.