AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Turing

Business Analyst - US

Analyze chatbot responses and evaluate them against business requirements.

Location and eligibility
Remote · United States only
Engagement type
Freelance
Compensation
Pay not listed
  • business analysis
  • requirements gathering
  • process mapping
Business Analysis & StrategyView job

AfterQuery

Research Scientist — Formal Methods / Computational Science

Join a research cohort of senior experts across mathematics, physics, chemistry, and biology. You’ll set standards for correct, high-quality reasoning on demanding real-world problems, then use those standards to assess frontier AI models. The work centers on research and evaluation, not production engineering. Applicants need a PhD or doctorate and at least 10 years of experience.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • formal methods
  • computational science
  • mathematics
Science & ResearchView job

Meridial by Invisible

Image Data Contributor and Evaluator

Contribute eligible images and add descriptions or context drawn from what each image shows and your personal knowledge. You’ll help assess how an AI photo product interprets image content, uses supplied information, connects details, and responds to comments or corrections, including whether its results feel accurate, trustworthy, safe, and helpful.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$9/hr
  • image annotation
  • image evaluation
  • image captioning
AI evaluationView job

Turing · via Braintrust

Senior Software Engineer - Python, TypeScript, JavaScript or Go

Help an AI research team build dependable evaluation workflows by pairing software engineering with preference-data review and rubric development. The remote contract runs for about three months, pays $100 per hour, and is open to candidates in the United States or Canada. The selection process starts with an information form and AI interview; selected candidates may then complete a coding challenge, with scores of 75% or higher advancing to team review and a possible live interview.

Location and eligibility
Remote · Canada, United States
Engagement type
Contract
Compensation
$100/hr
  • python
  • typescript
  • javascript
Software EngineeringView job

General Translation · via Mercor

Spanish (Peru) Linguistic Expert

Assess how well a large language model handles Peruvian Spanish, then help strengthen its language skills with carefully curated data. You will review outputs across tasks such as translation, summarization, dialogue, and grammar correction, and provide linguistic analysis that guides model training. The work calls for expert knowledge of Peruvian Spanish and professional fluency in English.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • peruvian spanish
  • spanish grammar
  • spanish syntax
Language & LinguisticsView job

Handshake AI

Linguistics Expert (Germany)

Use your linguistics or computational linguistics expertise on flexible, part-time contract projects that support AI research. You will create realistic analytical, corpus, or computational tasks, assess model responses, and write feedback on their accuracy and rigor. Candidates with at least two of the three profile areas described below are encouraged to apply. The work has no fixed schedule or minimum hour requirement.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$65/hr
  • linguistics
  • computational linguistics
  • linguistic analysis
Language & LinguisticsView job

SME Careers

Physicist

Review AI-generated physics answers for sound reasoning, correct calculations, and clear explanations. You’ll write prompts and model solutions, check claims against public sources, and compare responses across topics such as mechanics, electromagnetism, and optics. Applicants need a relevant graduate degree from a top 100 university, peer-reviewed publication experience, and C1-level English.

Location and eligibility
Remote · Eligible in 8 countries
Engagement type
Contract
Compensation
Up to $70/hr
  • physics
  • physical reasoning
  • classical mechanics
RLHFView job

micro1

Emergency Medicine Physician

An Emergency Medicine Physician will review clinical material for an AI training project, drawing on hands-on emergency care experience to assess scenarios and AI-generated responses. The work calls for sound clinical judgment, careful evaluation of medical information, and clear explanations of findings. The engagement is remote, part-time, and project-based, with a short AI interview as part of the application process.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
Pay not listed
  • emergency medicine
  • acute care assessment
  • clinical decision-making
Healthcare & MedicalView job

Ethos

Healthcare Strategy Consultant

Help train a foundational AI lab’s latest language model by creating, reviewing, and improving healthcare presentations and slide decks. Work remotely on your own schedule, with an ASAP start. Hours depend on client task volume and are not guaranteed; most experts work under 10 hours per week, with no weekly cap on hours or earnings.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100/hr
  • healthcare strategy
  • life sciences strategy
  • healthcare data exhibits
Health Informatics & Medical RecordsView job

Turing

Mathematics Expert (Master’s/Ph.D.)

Design and solve advanced math problems to evaluate language models.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • mathematics
  • algebra
  • calculus
Machine Learning & AIView job

AfterQuery

Radiologist / Radiation Sciences Expert (AI Safety)

Create and assess evaluation prompts that test whether AI models distinguish safe from unsafe requests in radiology and radiation science. You will explain the technical basis for each judgment and revise your work in response to structured reviewer feedback. Applicants must hold a relevant graduate degree, be citizens of a Five Eyes country, and work from within one of those countries.

Location and eligibility
Remote · Eligible in 5 countries
Engagement type
Not specified
Compensation
$150/hr
  • radiology
  • medical physics
  • radiation science
AI evaluationView job

Meridial by Invisible

Cantonese (Hong Kong) Translation and Localization Expert

Independent contractors with native-level Cantonese fluency and strong knowledge of Hong Kong usage will record voice content and assess audio samples. The work calls for close listening and careful comparison of spoken recordings with written text, with attention to pronunciation, clarity, natural phrasing, cultural nuance, and project guidelines.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$9/hr
  • cantonese
  • hong kong cantonese
  • translation
Language & LinguisticsView job

Turing · via Braintrust

Staff Research Engineer - Frontier AI and Reinforcement Learning - US and Canada

Advance frontier AI research across synthetic and agentic data, reinforcement learning, post-training, model understanding, benchmarks, and evaluation. You will investigate research questions, build prototypes, and help move proven findings into scalable AI systems. The remote contract runs for three months, starts immediately, and pays $57 USD per hour. Candidates must be based in the United States or Canada.

Location and eligibility
Remote · Canada, United States
Engagement type
Contract
Compensation
$57/hr
  • python
  • machine learning
  • reinforcement learning
Machine Learning & AIView job

General Translation · via Mercor

Spanish (Chile) Linguistic Expert

Assess how well a large language model handles Chilean Spanish across translation, summarization, dialogue, and grammar correction. You’ll refine text, annotate linguistic features, and give AI researchers detailed feedback on errors and language gaps. The work calls for strong command of Chilean Spanish and an understanding of how its regional usage differs from other Spanish varieties.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • chilean spanish
  • spanish grammar
  • spanish syntax
Language & LinguisticsView job

Handshake AI

Japanese AI Evaluation Specialist (Japan)

Use your experience with ChatGPT or similar chat assistants to compare AI responses and explain which answers better fit a user’s needs. You’ll complete annotation tasks and write feedback that can help future models personalize their responses. The ongoing, project-based work has no fixed schedule or minimum hours, so you can fit tasks around your current role.

Location and eligibility
Remote · Japan only
Engagement type
Part-time
Compensation
$30/hr
  • japanese
  • english
  • chatgpt
AI evaluationView job

SME Careers

Hindi Language Expert

Review and compare AI-generated Hindi content, check reasoning and factual accuracy, and write model answers that show sound methods. You will bring senior-level localization judgment to terminology, tone, and cultural nuance, using MQM/LQA principles and CAT tools to assess quality. The role is remote and hourly on a contract basis; the listing states that only candidates based in Hindi will be considered, and qualified experts may be contacted for future projects.

Location and eligibility
Remote · India only
Engagement type
Contract
Compensation
$5–$20/hr
  • hindi
  • english
  • translation
Language & LinguisticsView job

micro1

Radiologist

Experienced radiologists can bring their imaging expertise to a client’s AI training project. You’ll review radiology content, assess clinical scenarios and AI responses, and explain your judgments using established radiological principles. The work is remote, part-time, and project-based, and starts with a short AI interview covering your medical knowledge and experience.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
Pay not listed
  • radiology
  • diagnostic imaging
  • clinical decision-making
Health Informatics & Medical RecordsView job

Ethos

Software / AI / IT & Data Generalist

Help a leading foundational AI lab train its language model by creating, reviewing, and refining professional documents, spreadsheets, and slide decks. Work remotely on your own schedule, with hours tied to client task volume and not guaranteed. Most experts work under 10 hours per week, with no weekly cap on hours or earnings. The start date is ASAP.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$80/hr
  • software engineering
  • data engineering
  • artificial intelligence
Technical Writing & DocumentationView job

Turing

Growth Equity Analyst

Evaluate AI models for growth equity insights and investment strategies.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
100 per hour (currency not stated)
  • growth equity
  • company valuation
  • unit economics
Machine Learning & AIView job

AfterQuery

Nuclear Science & Engineering Expert (AI Safety)

Use your nuclear science or engineering expertise to assess how AI models handle safety-sensitive requests. You’ll create evaluation prompts, review work from other experts, and explain the technical basis for each safe-or-unsafe judgment. Applicants need an advanced degree, citizenship in a Five Eyes country, and physical presence in one of those countries while working.

Location and eligibility
Remote · Eligible in 5 countries
Engagement type
Not specified
Compensation
$150/hr
  • nuclear science
  • nuclear engineering
  • nuclear safety
CybersecurityView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.