AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Mercor

Audiobook QA Expert — Italian

Review Italian (Italy) AI-narrated audiobooks from home, listening for accuracy, natural delivery, and an enjoyable experience. You’ll mark speech errors and audio issues in review tools, then assess how well the narration holds up for listeners. The work is part-time, about 20 hours per week or four hours a day. Applicants can live anywhere, with a preference for people in regions where Italian is spoken natively.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$15–$20/hr
  • italian
  • english
  • audiobook quality assurance
Language & LinguisticsView job

SME Careers

Finnish Team Lead

Lead quality across Finnish AI training projects by reviewing model outputs and contributor work against project rubrics. You will coach trainers and QA reviewers, resolve questions on Finnish language choices, and maintain the guidance they use, including standards for selkokieli. The work also covers contributor onboarding and activity follow-up, with team coordination through Discord and quality records in Google Sheets.

Location and eligibility
Remote · Finland only
Engagement type
Contract
Compensation
Up to $55/hr
  • finnish
  • english
  • finnish grammar
Language & LinguisticsView job

Mercor

Finance Domain Expert — AI Training & Evaluation

A finance specialist will help a leading AI lab assess and improve how its models handle real financial work. You will review finance tasks and model responses, write task instructions and reference solutions, and shape benchmarks with the research team. The full-time W-2 role requires 40 hours per week for an initial six-month engagement and hybrid work in the Bay Area, with on-site attendance multiple days each week when required.

Location and eligibility
Hybrid · United States only
Engagement type
Full-time
Compensation
$60–$100/hr
  • finance
  • financial analysis
  • corporate finance
Finance & AccountingView job

SME Careers

Vietnamese Team Lead

Lead quality workflows for Vietnamese AI training projects by reviewing trainer and QA work against project rubrics, correcting language issues, and aligning contributors on project standards. The role calls for native or near-native Vietnamese, strong English, and experience with language review or AI training. No project is active now; qualified candidates may be contacted when a suitable assignment becomes available.

Location and eligibility
Remote · Cambodia, United States, Vietnam
Engagement type
Contract
Compensation
Up to $25/hr
  • vietnamese
  • english
  • vietnamese grammar
Language & LinguisticsView job

Mercor

Biotech Investment Analyst — Drug Asset & Company Assessment

Assess commercial drugs and development programs for a biotech and pharma research team’s AI evaluation work. You’ll build and critique rubrics, review investment theses, and evaluate roughly 5–10 companies during a remote pilot lasting about 10–20 hours over one to two weeks. Strong contributions may lead to recurring work as the project grows.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$120–$200/hr
  • biotechnology
  • pharmaceuticals
  • biotech investing
Business Analysis & StrategyView job

SME Careers

Czech Language Expert

Review and create Czech content that helps AI systems produce accurate, natural responses across areas such as education, customer support, translation, and localization. You will compare model answers, write reference examples, and explain language issues in English, with attention to Czech grammar, register, meaning, and cultural context.

Location and eligibility
Remote · Czechia only
Engagement type
Contract
Compensation
Up to $25/hr
  • czech
  • english
  • czech grammar
Language & LinguisticsView job

Mercor

Financial Analyst Talent Network

Mercor’s network connects financial analysts with future contract projects for AI labs and companies. After you submit a profile and complete an AI interview, Mercor reviews your credentials and may match you with work as projects arise. Assignments can involve training or evaluating finance-focused AI models, building real-world finance tasks, and giving domain feedback. Typical commitments range from 15 to 30 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$180/hr
  • financial modeling
  • financial forecasting
  • financial statement analysis
Machine Learning & AIView job

SME Careers

Polish Language Expert

Review AI-generated Polish and create reference responses that show accurate, natural writing across general knowledge, customer support, education, and conversation. You will judge grammar, meaning, tone, cultural fit, and prompt adherence, then explain issues in English. The role requires native or near-native Polish, professional English at C1 or higher, and at least three years of relevant language-focused experience.

Location and eligibility
Remote · Poland only
Engagement type
Contract
Compensation
Up to $30/hr
  • polish
  • english
  • copyediting
Language & LinguisticsView job

Mercor

Biology Expert

Mercor keeps a standing pool of biologists for short-notice AI training and evaluation projects. You may write research problems with reference answers, assess model-generated experimental designs and interpretations, and identify answers that fail to account for real bench conditions. Apply with a resume, confirm where you work from, and complete an AI interview of about 20 minutes. Project invitations may arrive within a week or take several months.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70–$105/hr
  • biology
  • life sciences
  • experimental design
Science & ResearchView job

SME Careers

Lithuanian Team Lead

Guide quality across Lithuanian AI training projects by reviewing language output and trainer work against project rubrics. You will coach trainers and QA reviewers, resolve Lithuanian language questions, and keep guidance current in style guides, trackers, and onboarding materials. The role calls for native or near-native Lithuanian, strong English, and at least three years of relevant language or quality-review experience.

Location and eligibility
Remote · Lithuania only
Engagement type
Contract
Compensation
Up to $35/hr
  • lithuanian
  • english
  • lithuanian grammar
Language & LinguisticsView job

Mercor

Applied Engineer, Evaluations Role

Build and refine software engineering evaluations from completed pull requests, using Mercor’s in-house framework to assess frontier coding agents such as Claude Code and Codex. You’ll work with an internal research team whose benchmarks compare frontier large language models, then take ownership of evaluation selection, development, and refinement after onboarding.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100–$120/hr
  • typescript
  • javascript
  • python
Machine Learning & AIView job

SME Careers

Urdu Team Lead

Lead Urdu quality work across AI training projects by reviewing contributor output against project rubrics, correcting language and formatting issues, and guiding trainers and QA reviewers. You will manage updates and documentation through tools such as Discord, Google Docs, and Google Sheets. The remote contract selection process includes an AI interview, a domain-specific task, and a recruiter interview.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • urdu
  • english
  • urdu proofreading
Language & LinguisticsView job

Mercor

Physics Expert

Mercor keeps this physics listing open as a standing pool for AI training and evaluation projects, rather than a single active opening. You may write discipline-specific problems and reference answers or assess model derivations and numerical work. After you submit a resume, confirm your work location, and complete an AI interview of about 20 minutes, Mercor may contact you when a project fits. Matching can take a week or several months.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70–$100/hr
  • physics
  • derivations
  • numerical analysis
Machine Learning & AIView job

SME Careers

Malayalam Expert with Mathematical Background

Review AI-generated Malayalam for grammar, meaning, tone, and cultural fit, and create reference answers that demonstrate strong Malayalam writing. You will compare model responses, check claims when needed, and explain language or reasoning issues in written English. The role requires a mathematics degree, native or near-native Malayalam, C1-level English, and at least three years of relevant professional experience.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $20/hr
  • malayalam
  • english
  • copyediting
Language & LinguisticsView job

Mercor

Pharmaceutical R&D Domain Expert

Bring hands-on drug development expertise to AI research by reviewing pharmaceutical knowledge tasks and model outputs, writing task instructions and reference answers, and shaping evaluation benchmarks. Cincinnatus LLC employs this full-time W-2 role, with placement alongside a leading AI lab’s research team. The position requires Bay Area residence or relocation at your own expense, plus on-site work several days each week when required.

Location and eligibility
Hybrid · United States only
Engagement type
Full-time
Compensation
$75–$115/hr
  • pharmaceutical research and development
  • drug discovery
  • drug development
Developer RelationsView job

SME Careers

Nepali Expert with Mathematical Background

Review AI-generated Nepali writing and produce reference content that demonstrates accurate, natural language use. You will assess grammar, meaning, tone, cultural fit, and reasoning, then explain issues in written English and compare candidate responses. The role requires a mathematics degree, advanced Nepali and English proficiency, and at least three years of relevant language-focused experience.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $15/hr
  • nepali
  • english
  • devanagari
Language & LinguisticsView job

Mercor

Biochemistry & Life Sciences Domain Expert

A senior life sciences specialist will help a leading AI lab assess and improve how its models reason about research. You will review scientific tasks and model responses, write task instructions and reference solutions, and design evaluation benchmarks. Cincinnatus LLC employs this full-time W-2 role, with placement alongside the client’s research teams. The position requires Bay Area residence and on-site work multiple days each week when required.

Location and eligibility
Hybrid · United States only
Engagement type
Full-time
Compensation
$65–$105/hr
  • biochemistry
  • molecular biology
  • cell biology
Science & ResearchView job

SME Careers

Assamese Team Lead

Lead quality reviews for Assamese AI training projects by checking contributor work against project rubrics and language standards. You will guide trainers and QA reviewers, resolve questions about meaning and cultural context, and maintain resources such as style guides and onboarding materials. The role is remote and contract-based; selection includes an AI interview, a domain-specific task, and a recruiter interview.

Location and eligibility
Remote · Bangladesh, Bhutan, India
Engagement type
Contract
Compensation
Up to $30/hr
  • assamese
  • english
  • assamese quality assurance
Language & LinguisticsView job

Mercor

Radiologist

Assess AI responses to radiology questions using de-identified patient charts. You will compare two answers, judge their accuracy, safety, and fit with current standards of care, then explain your assessment and flag risks to patient safety. The role requires an ABR Diagnostic Radiology board certification, an active US medical license, and at least one year of independent practice after training.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$350/hr
  • radiology
  • diagnostic radiology
  • abr certification
Healthcare & MedicalView job

SME Careers

Japanese Team Lead

Lead Japanese quality reviews across AI training projects, checking model outputs and contributor work against project rubrics. You’ll give specific feedback, answer language questions, coordinate updates through Discord, and maintain resources such as Japanese style guides and QA trackers. This is a remote contract role with no immediate project; qualified candidates may be contacted when relevant work becomes available.

Location and eligibility
Remote · Eligible in 7 countries
Engagement type
Contract
Compensation
Up to $55/hr
  • japanese
  • english
  • japanese quality assurance
Language & LinguisticsView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.