AIWorkJobs
Handshake AI logoHandshake AIPlatform listing

Domain Expert, AI Evaluation (US)

Use your STEM expertise to help improve large language models across scientific and technical fields. Project work may involve creating and solving challenging problems, writing domain-specific prompts, and judging…

Remote · United States onlyPart-time
Work arrangement
Remote
Eligibility
United States only
Engagement
Part-time
Compensation
$200/hr
Specialty
AI Training

About the role

Use your STEM expertise to help improve large language models across scientific and technical fields. Project work may involve creating and solving challenging problems, writing domain-specific prompts, and judging model answers for accuracy and reasoning quality. The year-round fellowship offers remote, asynchronous project work for about 5 to 20 hours per week; assignments depend on project availability.

What you would do

  • Write challenging problems grounded in your field of expertise.
  • Solve subject-specific problems and create prompts for large language models.
  • Assess model responses for correctness and quality of reasoning.
  • Research topics that interest you with support from AI.
  • Turn complex research knowledge into clear task instructions and evaluation criteria.

Requirements

  • Reside in the United States and hold US work authorization.
  • Be a PhD student, PhD graduate, or postdoctoral researcher, or hold a master's degree with relevant experience.
  • Have a degree in a relevant field such as mathematics, chemistry, biology, physics, engineering, computer science, or medicine.
  • Bring at least 2 years of research or industry experience in your field, in addition to your degree.
  • Have deep subject knowledge and the ability to explain key concepts beyond current AI systems.
  • Write clearly enough to communicate complex research ideas as structured instructions and evaluation criteria.
  • Work without direct supervision in a remote, asynchronous setting.
  • Have approximately 5 to 20 hours available each week.

Who should apply

STEM researchers and professionals with an advanced degree and at least 2 years of field experience may be a fit. Applicants should be based in the US, hold US work authorization, and have time for 5 to 20 hours of remote, asynchronous project work each week.

How applying works on Handshake AI

Create a Handshake account, apply and verify your identity, then complete project training before contributing.

  1. Create a Handshake account.
  2. Apply to the project and verify your identity.
  3. Get matched to a project and complete its training.
  4. Contribute to the project and get paid for completed work.

Paid steps: Not stated by the source

Handshake AI lists projects for US-based contributors. Some specialized projects add their own vetting.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Handshake AI process and its official source on the Handshake AI page.

Skills mentioned by the source

  • mathematics
  • chemistry
  • biology
  • physics
  • engineering
  • computer science
  • medicine
  • large language models
  • prompt writing
  • model evaluation
  • research

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: domain-expert-ai-evaluation-us-015470. Source: Handshake AI. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Handshake AI

AI Evaluation Specialist

Contribute to short-term AI research projects with leading AI labs by applying your academic knowledge to improve large language models in specific fields and topics. Work remotely with no minimum hour commitment. Handshake provides brief training, and you must pass one assessment before starting. Successful project work may qualify you for future projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$17/hr
  • large language models
  • ai evaluation
  • ai training
Machine Learning & AIView job

Outlier · via Braintrust

STEM PhD Expert for AI Reasoning & Evaluation

Use your doctoral expertise to assess how AI models handle technical questions and domain-specific content. You’ll check factual accuracy and relevance, compare model responses, and contribute questions and answers in machine learning and AI. The remote contract runs through the end of June, with a possible extension based on project needs. Applicants must live in the United States, Canada, Puerto Rico, Mexico, the United Kingdom, Australia, New Zealand, or Argentina.

Location and eligibility
Remote · Eligible in 8 countries
Engagement type
Contract
Compensation
$50–$150/hr
  • machine learning
  • artificial intelligence
  • computer science
Machine Learning & AIView job

Mercor

Biology & Life Sciences Domain Expert

Bring senior research expertise to the evaluation of AI systems in biology and the life sciences. You will assess scientific tasks and model responses, create precise problem specifications and reference solutions, and build research-level benchmarks in your specialty. The role suits a practicing specialist who can distinguish sound scientific reasoning from claims that only sound convincing.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$90–$140/hr
  • biology
  • life sciences
  • biochemistry
Science & ResearchView job

Turing

Software Engineer – AI Research & Evaluation (US-based)

Create and evaluate datasets to enhance AI-generated coding solutions.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • java
Machine Learning & AIView job