AIWorkJobs
Handshake AI logoHandshake AIPlatform listing

AI Evaluation Specialist (Canada)

Apply your academic knowledge to short-term projects that help improve large language models across different subjects. Handshake AI welcomes candidates from any discipline who live in Canada and hold Canadian work…

Remote · Canada onlyPart-time
Work arrangement
Remote
Eligibility
Canada only
Engagement
Part-time
Compensation
$15/hr
Specialty
AI Training

About the role

Apply your academic knowledge to short-term projects that help improve large language models across different subjects. Handshake AI welcomes candidates from any discipline who live in Canada and hold Canadian work authorization. You’ll complete a brief training and one assessment before starting, then work remotely with no minimum hour commitment. Strong project results can qualify you for future assignments.

What you would do

  • Contribute to short-term AI training projects from a remote location.
  • Apply academic knowledge to improve large language models in specific fields and topics.
  • Critically assess and challenge advanced AI systems using your knowledge and reasoning.
  • Follow detailed written instructions and produce accurate work.

Requirements

  • Live in Canada and hold authorization to work in Canada.
  • Currently pursue or have completed a Bachelor's degree or higher at an institution in the United States, Canada, Australia, or the United Kingdom. In-progress degrees qualify.
  • Bring native-level English fluency and strong written communication.
  • Pay close attention to detail and follow detailed written instructions accurately.
  • Work independently in a remote, asynchronous setting.
  • Complete a brief training and one assessment before beginning project work.

Who should apply

Candidates pursuing or holding a degree in any discipline can apply if they live in Canada, have Canadian work authorization, and meet the English and instruction-following requirements. The work suits people who can assess AI systems independently and commit to short-term projects without a minimum number of hours.

How applying works on Handshake AI

Create a Handshake account, apply and verify your identity, then complete project training before contributing.

  1. Create a Handshake account.
  2. Apply to the project and verify your identity.
  3. Get matched to a project and complete its training.
  4. Contribute to the project and get paid for completed work.

Paid steps: Not stated by the source

Handshake AI lists projects for US-based contributors. Some specialized projects add their own vetting.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Handshake AI process and its official source on the Handshake AI page.

Skills mentioned by the source

  • large language models
  • ai evaluation
  • ai training
  • academic research
  • written communication
  • english

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: ai-evaluation-specialist-canada-330001. Source: Handshake AI. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Handshake AI

AI Evaluation Specialist

Contribute to short-term AI research projects with leading AI labs by applying your academic knowledge to improve large language models in specific fields and topics. Work remotely with no minimum hour commitment. Handshake provides brief training, and you must pass one assessment before starting. Successful project work may qualify you for future projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$17/hr
  • large language models
  • ai evaluation
  • ai training
Machine Learning & AIView job

Outlier · via Braintrust

STEM PhD Expert for AI Reasoning & Evaluation

Use your doctoral expertise to assess how AI models handle technical questions and domain-specific content. You’ll check factual accuracy and relevance, compare model responses, and contribute questions and answers in machine learning and AI. The remote contract runs through the end of June, with a possible extension based on project needs. Applicants must live in the United States, Canada, Puerto Rico, Mexico, the United Kingdom, Australia, New Zealand, or Argentina.

Location and eligibility
Remote · Eligible in 8 countries
Engagement type
Contract
Compensation
$50–$150/hr
  • machine learning
  • artificial intelligence
  • computer science
Machine Learning & AIView job

Turing

Software Engineer – AI Research & Evaluation (US-based)

Create and evaluate datasets for training large language models in Python.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

micro1

English Language Expert (Canada)

Contribute to an audio annotation project that helps train AI systems to recognize Canadian English. You’ll review multi-speaker recordings, label audio and speaker details, and correct speech-recognition transcripts. The work calls for a strong ear for Canadian regional accents, vocabulary, spelling, and features such as Canadian raising. The role is based in Canada.

Location and eligibility
Remote · Canada only
Engagement type
Contract
Compensation
$20–$45/hr
  • Canadian English
  • Dialect
  • Linguistics
Language & LinguisticsView job