AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

AfterQuery

Content Writer & AI Evaluation Specialist (UK/US)

Create and assess writing for AI training, from prompts and stories to articles, summaries, and dialogue. You’ll draw on at least three years of English content writing or copywriting experience, apply your knowledge of large language models, and judge text for accuracy, quality, and fit with user intent. The independent contractor engagement calls for 40 hours each week over 3–6 months.

Location and eligibility
Remote · United Kingdom, United States
Engagement type
Not specified
Compensation
$43/hr
  • content writing
  • copywriting
  • content editing
Content, Communications & PRView job

Mercor

Bilingual Spanish Generalist Expert — AI Safety

Help evaluate how advanced AI models respond to sensitive topics in Spanish. You’ll write prompts, assess conversations against structured guidelines, and explain judgments about adversarial wording and escalation patterns. The project starts immediately. No AI or machine learning background is needed; the team provides workflow training.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$43–$47/hr
  • spanish
  • english
  • ai safety
Language & LinguisticsView job

Handshake AI

Utility Technician

Use your utility field experience to create expert training material and review AI-generated answers about real-world utility work. The project centers on field operations, metering systems, and utility infrastructure. Work remotely on an asynchronous, flexible schedule with no minimum hours; contributors typically work 5–20 hours per week while a project is active. Placement depends on project needs, with consideration for future projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • utility field operations
  • metering
  • infrastructure maintenance
Energy & Power GenerationView job

SME Careers

Persian Language Expert

Review AI-generated Persian responses and create reference content, including prompts, model answers, and edits. Assess grammar, meaning, tone, cultural fit, factual claims, and right-to-left formatting; compare outputs and explain your ratings in English. The role requires native or near-native Persian, C1-level English, and at least three years of relevant language-focused experience.

Location and eligibility
Remote · Tajikistan only
Engagement type
Contract
Compensation
Up to $25/hr
  • persian
  • farsi
  • english
Language & LinguisticsView job

Turing

Emergency Medicine Physician (MD/DO)

Evaluate AI responses for accuracy in emergency medicine scenarios.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • emergency medicine
  • acute care
  • trauma management
Healthcare & MedicalView job

AfterQuery

Paramedic Expert

Create ALS scenarios that help AI labs assess emergency medicine judgment. You will write cases from dispatch through transfer of care, explain the reasoning behind interventions, and evaluate model responses for protocol accuracy and patient safety. The work is remote, asynchronous contract work, with a commitment of at least 10 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$68/hr
  • advanced life support
  • paramedicine
  • emergency medical services
AI evaluationView job

Mercor

Bilingual Hindi Generalist Expert — AI Safety

Help assess how AI models respond to sensitive topics in Hindi. You’ll write prompts, apply review guidelines, and explain your judgments about risky or adversarial language. The role calls for native or near-native Hindi and business-level written English. No AI or machine learning experience is needed; training covers the workflow. The project starts immediately.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$18–$22/hr
  • hindi
  • english
  • ai safety
Language & LinguisticsView job

Handshake AI

Construction Project Manager

Use your retail construction expertise on ongoing, project-based AI research work. You’ll create training scenarios, assess AI responses, and write feedback grounded in cost estimation and architectural plan review. The part-time work is remote and asynchronous, with no fixed schedule or minimum hours, so you can fit tasks around your current work.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail construction
  • cost estimation
  • construction project management
AI evaluationView job

SME Careers

Chemical Engineer Quality Assurance Lead (QAL)

Review chemical engineering AI outputs and contributor work against technical rubrics, with attention to calculations, units, clarity, and process safety. You will guide trainer and QA workflows, share actionable feedback, run onboarding, and maintain project references such as style guides and calibration tasks. The role calls for a chemical engineering background and at least three years of relevant professional experience.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $105/hr
  • chemical engineering
  • process engineering
  • quality assurance
Quality Assurance & TestingView job

Turing

Domain Expert- Sports

Evaluate and improve AI models using sports knowledge and data analysis.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • sports analysis
  • sports journalism
  • sports statistics
Machine Learning & AIView job

AfterQuery

Creative Technologist — Audio / Design / UX

Join a research cohort of creative technology experts across audio, design, and UX. You’ll define standards for strong work by creating expert-level problems and reference materials, then judge how well frontier AI models handle them. The role centers on research and evaluation, not production engineering. Applicants need 6–10 years of experience and a bachelor’s degree; a master’s degree is a plus.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • creative technology
  • audio engineering
  • design
Design & CreativeView job

Mercor

Mathematics Expert

Mercor keeps this listing open to build a pool of mathematicians for future AI training and evaluation projects; it does not represent one active opening. You may write research- or competition-level problems with solutions, assess model-generated proofs, and identify gaps in reasoning. After you apply, a short AI interview takes about 20 minutes. Matching projects may start within a week or several months.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40–$75/hr
  • mathematics
  • proof verification
  • mathematical reasoning
Machine Learning & AIView job

Handshake AI

Hindi AI Evaluation Specialist (Singaporean Dialect)

Use your Singaporean Hindi knowledge to compare and rank AI-generated responses, explain your preferences, and give written feedback that can help future models tailor answers to users. You’ll complete ongoing, project-based work through an annotation platform, drawing on your real-world experience with AI tools. Set your own pace; the work has no fixed schedule or minimum hour requirement.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$30/hr
  • hindi
  • singaporean hindi
  • english
AI evaluationView job

SME Careers

Public Health Expert

Use your epidemiology and public health expertise to assess AI-generated answers or write reference prompts and model responses. You will check population-health reasoning, evidence interpretation, surveillance logic, and recommendations for accuracy, clarity, and safety. This remote, hourly contract requires at least five years of professional public health experience and C1 English proficiency; qualified experts may be contacted when relevant projects arise.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $70/hr
  • public health
  • epidemiology
  • biostatistics
Health Informatics & Medical RecordsView job

AfterQuery

Medical Assistant Expert

Create clinical questions and case studies for AI training, then assess model answers for clinical accuracy and alignment with medical assisting standards. The work draws on hands-on experience across clinical and administrative practice, covering subjects such as patient intake, vital signs, procedures, EHR documentation, lab work, and pharmacology basics.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$45/hr
  • medical assisting
  • clinical practice
  • patient intake
Healthcare & MedicalView job

Mercor

Audiobook QA Expert — English (US)

Listen to AI-generated audiobooks in US and North American English and assess whether the narration sounds natural, accurate, and enjoyable. You’ll mark speech and audio issues in review tools, identify where the listening experience falters, and rate listener satisfaction. The role calls for native or near-native English fluency, regular audiobook listening, and availability for about 20 hours each week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$20–$25/hr
  • audiobook quality assurance
  • audio annotation
  • speech evaluation
Language & LinguisticsView job

Handshake AI

Distribution Ops Analyst

Use your energy industry experience to create expert training data and assess AI responses about maintenance workflows and reliability engineering. The work draws on hands-on knowledge of tools such as IBM Maximo, Oracle OMS, AVEVA PI, and ArcGIS. Projects are remote, hourly, and flexible, with no minimum hours; contributors often work about 5–20 hours a week during active projects. Placement depends on project needs, with possible consideration for future projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • asset management
  • maintenance planning
  • maintenance reliability
Data Science & AnalyticsView job

SME Careers

Arabic Language Expert

Review Arabic and English AI responses or create bilingual training examples, with a focus on reasoning, accuracy, and clear explanations. You will check claims, spot flawed methods, and compare candidate answers using task rubrics. The work is remote and contract-based; there is no immediate project, but qualified experts may hear about relevant work through the network.

Location and eligibility
Remote · Egypt, Saudi Arabia, South Africa
Engagement type
Contract
Compensation
Up to $15/hr
  • arabic
  • english
  • modern standard arabic
Language & LinguisticsView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.