AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

AfterQuery

Machine Learning / Data Science Expert

Work on project-based data science and machine learning tasks similar to those found in analytics, AI research, and machine learning engineering. Projects run over the next 2–3 weeks, with asynchronous work and an expected commitment of 10–20 hours per week for each project you accept. You’ll help develop and assess models for business applications.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$80/hr
  • machine learning
  • data science
  • predictive modeling
Machine Learning & AIView job

Google DeepMind · via Braintrust

Brand & Advertising Art Director

Create brand identity references and advertising assets, then assess visual designs generated by AI models for training and evaluation projects. The work draws on studio or agency art direction, with a focus on consistent brand systems, multi-format campaigns, and clear design standards. Shortlisted candidates complete a 15-minute AI interview, followed by a 45-minute technical interview with the team.

Location and eligibility
On-site · United States only
Engagement type
Contract
Compensation
$30–$52/hr
  • brand identity
  • art direction
  • advertising design
Design & CreativeView job

General Translation · via Mercor

Czech Linguistic Expert

Assess how well a large language model handles Czech, from translation and summaries to dialogue and grammar correction. You will also refine Czech-language material and annotate linguistic features to help improve the model’s understanding and generation. The work calls for expert Czech judgment, professional English, and experience with translation, editing, linguistic annotation, or Czech NLP data.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • czech
  • english
  • translation
Language & LinguisticsView job

Handshake AI

Bahasa Indonesian AI Evaluation Specialist (Indonesia)

Use your experience with ChatGPT and other AI chat assistants to compare responses and explain which answer better suits a particular user. You’ll complete annotation tasks, write feedback in Bahasa Indonesian, and share your own ChatGPT conversation history for research and product improvement; Handshake will handle that history confidentially. The ongoing project has no set schedule or minimum hours, so you can fit tasks around your current work.

Location and eligibility
Remote · Indonesia only
Engagement type
Part-time
Compensation
$15/hr
  • bahasa indonesian
  • english
  • chatgpt
AI evaluationView job

SME Careers

Finnish Language Expert

Review AI-generated Finnish and build reference answers that show strong grammar, accurate meaning, and appropriate tone. You will compare model responses, explain language and reasoning issues in English, and check for factual errors, cultural mismatches, and unsafe or misleading claims. The role requires native or near-native Finnish, C1 English, and at least three years of relevant language-focused experience.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $50/hr
  • finnish
  • english
  • copyediting
Language & LinguisticsView job

micro1

AI Safety & Evaluation Specialist

Evaluate how personal AI agents handle sensitive information through privacy-focused tests and response reviews. The work centers on spotting improper disclosures and data-protection risks, then recording evidence-based feedback. This is a United States-based, part-time contractor project lasting six weeks. Applicants complete an AI interview; no other assessments are required.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$30–$50/hr
  • privacy risk assessment
  • data protection
  • ai evaluation
Data Science & AnalyticsView job

Ethos

Market Research / Competitive Intelligence Analyst

Help a foundational AI lab train its latest language model by creating, evaluating, and refining professional research materials across documents, spreadsheets, and slide decks. Work remotely on your own schedule, with task volume shaping available hours. Most experts work under 10 hours per week, though no weekly hours cap applies. The work can start as soon as possible.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • market research
  • competitive intelligence
  • competitive landscape analysis
Market Research & InsightsView job

Turing

Prompt & Verifier

Design and refine prompts for AI interactions across various tools.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • prompt engineering
  • api
  • json
Technical Writing & DocumentationView job

AfterQuery

Medical Expert

Medical experts help train and assess AI systems that handle clinical and healthcare questions. The work can include creating challenging prompts, checking answers for accuracy and sound medical reasoning, and catching errors in lab interpretation or differential diagnoses. Topics span diagnosis, treatment planning, pharmacology, patient safety, and nursing care.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$125/hr
  • clinical diagnosis
  • treatment planning
  • pharmacology
Healthcare & MedicalView job

Google DeepMind · via Braintrust

Commercial Video Editor & Post Lead

Create reference advertising edits and assess AI-generated video for training and evaluation projects. You’ll bring studio or agency editing experience to hands-on post-production, build pacing and continuity standards, and give specific feedback on model output. The work covers commercial and social content in several aspect ratios, with a 15-minute AI interview for shortlisted candidates and a 45-minute technical interview for those who advance.

Location and eligibility
On-site · United States only
Engagement type
Contract
Compensation
$30–$52/hr
  • video editing
  • commercial advertising
  • adobe premiere pro
Design & CreativeView job

General Translation · via Mercor

Armenian Linguistic Expert

Assess how well a large language model handles Armenian across translation, summarization, dialogue, and grammar correction. You will refine Armenian text, annotate linguistic features, and share analysis that helps AI researchers address language gaps and improve model training. The work calls for expert knowledge of Armenian grammar, style, regional variation, and cultural context.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • armenian
  • english
  • linguistic annotation
Language & LinguisticsView job

Handshake AI

Maintenance Planner

Use your energy industry experience in asset management, maintenance planning, or grid operations to create expert training data and assess AI responses for accuracy and relevance. The work draws on your knowledge of maintenance workflows, reliability engineering, and workplace tools. Projects run on a remote, flexible schedule with no minimum hours; contributors often work 5–20 hours per week during active projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • asset management
  • maintenance planning
  • maintenance reliability
Energy & Power GenerationView job

SME Careers

Python (ML-Focused) Team Lead

Review Python code and machine learning work for correctness, sound methodology, reproducibility, and compliance with project rubrics. You will guide trainer and QA workflows, give contributors actionable feedback, and maintain resources such as calibration tasks and style guides. This remote contract has no immediate project; qualified candidates may be contacted when relevant work opens. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $120/hr
  • python
  • machine learning
  • data science
Machine Learning & AIView job

micro1

Personal Injury Lawyer

Review legal scenarios and AI-generated legal work for a project aimed at improving legal reasoning and accuracy in AI systems. You will assess liability, spot gaps or errors, and give structured corrections grounded in your legal expertise. Applicants must hold a J.D. from a U.S. law school, maintain an active license in at least one U.S. state, and live in the United States.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$170/hr
  • legal reasoning
  • issue-spotting
  • document review
LegalView job

Ethos

FP&A Manager / Director

Help a leading foundational AI lab improve its language model’s performance on professional finance presentations. You’ll create, assess, and refine slide decks for budgeting, forecasting, variance analysis, business reviews, board reporting, long-range planning, and KPI dashboards. The work is fully remote, with hours tied to client task volume and no guaranteed weekly hours.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$80/hr
  • fp&a
  • powerpoint
  • budgeting
Finance & AccountingView job

Turing

AI Quality Analyst - English

Evaluate AI personalization quality using your personal experiences and insights.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • ai evaluation
  • personalization evaluation
  • prompt engineering
Quality Assurance & TestingView job

AfterQuery

Registered Nurse Expert

Use your nursing experience to assess and create clinical material for AI training and evaluation. You will review AI-generated patient education, triage guidance, and clinical documentation for accuracy and safety, then provide examples grounded in real nursing practice. The work is remote, asynchronous, and paid hourly, so you choose when and how much to work.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$68/hr
  • nursing
  • registered nursing
  • clinical evaluation
Healthcare & MedicalView job

Turing · via Braintrust

Emergency Medicine Physician - AI Evaluation

Use your emergency medicine expertise on a 12-week remote contract evaluating AI systems. You’ll build clinical cases and scoring rubrics, assess model responses, and help set defensible standards for emergency decision-making and patient safety. The project targets a November 2, 2026 start and offers 20 or 40 hours per week, with four hours of overlap with Pacific working hours. Selection includes an application review and assessment.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$135/hr
  • emergency medicine
  • clinical decision-making
  • clinical case development
Health Informatics & Medical RecordsView job

General Translation · via Mercor

Japanese Linguistic Expert

Assess how well an LLM handles Japanese across translation, summaries, dialogue, and grammar correction. You will also edit and annotate Japanese text, flag language and cultural issues, and share detailed feedback with AI researchers. The work calls for native or near-native Japanese fluency, professional English, and experience with Japanese language work such as translation, editing, or annotation.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • japanese
  • english
  • translation
Language & LinguisticsView job

Handshake AI

Engineering Professional

Contribute engineering expertise to an AI research project focused on how models interpret professional tasks and language. Project work may include writing industry-specific prompts and reviewing LLM responses. The program runs year-round, but project placement depends on availability. Work remotely on a flexible schedule, with no minimum hour commitment.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • mechanical engineering technology
  • electrical engineering
  • bioengineering
Machine Learning & AIView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.