AIWorkJobs
Handshake AI logoHandshake AIPlatform listing

AI Evaluation Specialist

Contribute to short-term AI research projects with leading AI labs by applying your academic knowledge to improve large language models in specific fields and topics. Work remotely with no minimum hour commitment…

Remote · United States onlyPart-time
Work arrangement
Remote
Eligibility
United States only
Engagement
Part-time
Compensation
$17/hr
Specialty
AI Training

About the role

Contribute to short-term AI research projects with leading AI labs by applying your academic knowledge to improve large language models in specific fields and topics. Work remotely with no minimum hour commitment. Handshake provides brief training, and you must pass one assessment before starting. Successful project work may qualify you for future projects.

What you would do

  • Use your academic knowledge and reasoning to assess and challenge advanced AI systems.
  • Help improve large language models in specific fields and subject areas.
  • Contribute to AI research initiatives in collaboration with leading AI labs.
  • Follow detailed written instructions and complete assigned work with care.

Requirements

  • Live in the United States and hold US work authorization.
  • Be pursuing or have completed a bachelor's degree or higher at an institution in the United States, Canada, Australia, or the United Kingdom.
  • Write and communicate in English at a native level.
  • Follow detailed written instructions accurately and pay close attention to details.
  • Work independently in a remote, asynchronous setting.
  • Apply critical thinking and reasoning to evaluate AI systems.
  • Complete brief training and pass one assessment before beginning project work.

Who should apply

Candidates based in the United States with US work authorization can apply while pursuing or after completing a bachelor's degree or higher. The role suits people with native-level English, strong written communication, and an interest in evaluating AI systems through careful reasoning.

How applying works on Handshake AI

Create a Handshake account, apply and verify your identity, then complete project training before contributing.

  1. Create a Handshake account.
  2. Apply to the project and verify your identity.
  3. Get matched to a project and complete its training.
  4. Contribute to the project and get paid for completed work.

Paid steps: Not stated by the source

Handshake AI lists projects for US-based contributors. Some specialized projects add their own vetting.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Handshake AI process and its official source on the Handshake AI page.

Skills mentioned by the source

  • large language models
  • ai evaluation
  • ai training
  • critical thinking
  • written communication
  • english

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: ai-evaluation-specialist-054661. Source: Handshake AI. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Handshake AI

AI Evaluation Specialist (Canada)

Apply your academic knowledge to short-term projects that help improve large language models across different subjects. Handshake AI welcomes candidates from any discipline who live in Canada and hold Canadian work authorization. You’ll complete a brief training and one assessment before starting, then work remotely with no minimum hour commitment. Strong project results can qualify you for future assignments.

Location and eligibility
Remote · Canada only
Engagement type
Part-time
Compensation
$15/hr
  • large language models
  • ai evaluation
  • ai training
Machine Learning & AIView job

micro1

AI Safety & Evaluation Specialist

Evaluate how personal AI agents handle sensitive information through privacy-focused tests and response reviews. The work centers on spotting improper disclosures and data-protection risks, then recording evidence-based feedback. This is a United States-based, part-time contractor project lasting six weeks. Applicants complete an AI interview; no other assessments are required.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$30–$50/hr
  • privacy risk assessment
  • data protection
  • ai evaluation
Data Science & AnalyticsView job

Outlier · via Braintrust

STEM PhD Expert for AI Reasoning & Evaluation

Use your doctoral expertise to assess how AI models handle technical questions and domain-specific content. You’ll check factual accuracy and relevance, compare model responses, and contribute questions and answers in machine learning and AI. The remote contract runs through the end of June, with a possible extension based on project needs. Applicants must live in the United States, Canada, Puerto Rico, Mexico, the United Kingdom, Australia, New Zealand, or Argentina.

Location and eligibility
Remote · Eligible in 8 countries
Engagement type
Contract
Compensation
$50–$150/hr
  • machine learning
  • artificial intelligence
  • computer science
Machine Learning & AIView job

Ethos

Software Engineer

Work with a foundational AI lab to train a language model on software development. You will create, assess, and refine AI-generated work across core engineering workflows. The role is remote with a flexible schedule. Work depends on client task volume, and most experts contribute fewer than 10 hours per week; hours and earnings have no weekly cap but are not guaranteed.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$100/hr
  • software engineering
  • system design
  • algorithms
Software EngineeringView job