AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

SME Careers

Slovenian Team Lead

Guide quality across Slovenian AI training projects by reviewing generated content and contributor work against project rubrics. You will give specific feedback, answer language questions, support trainer onboarding, and maintain resources such as style guides and quality trackers. The role calls for native or near-native Slovenian, strong English, and experience with language review or related workflows; coordination happens through tools such as Discord and Google Sheets.

Location and eligibility
Remote · Slovenia only
Engagement type
Contract
Compensation
Up to $30/hr
  • slovenian
  • english
  • localization qa
Language & LinguisticsView job

micro1

Pediatric Hematology/Oncology Physician

A United States-based pediatric hematology/oncology physician will review AI-generated transcripts and notes from outpatient visits for a part-time, project-based customer assignment. Your clinical feedback will address accuracy, completeness, and relevance in documentation, including EHR notes. Applicants complete an AI interview focused on their clinical background.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$150/hr
  • pediatric hematology/oncology expertise
  • clinical documentation review
  • chemotherapy management
AI evaluationView job

Ethos

Investment Banking Analyst / Associate

Help a leading foundational AI lab train its language model on professional presentations and slide decks. You’ll create, assess, and refine materials across core investment banking workflows. The role is remote, with flexible scheduling; task volume determines available hours, and most experts work under 10 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100/hr
  • investment banking
  • powerpoint
  • pitch books
Business Analysis & StrategyView job

AfterQuery

Public Sector Expert

Use your government or public agency experience to help train and assess AI models on practical public sector work. You’ll create realistic work problems, examine budget, grant and program reporting data, and catch errors in AI responses. The project offers remote, part-time work with flexible hours and hourly pay. Applicants need at least five years of relevant experience, so the role does not suit students or early-career professionals.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$70/hr
  • public sector
  • budget analysis
  • grant management
Data Science & AnalyticsView job

SureHost · via Braintrust

AI Model Benchmarking Intern Iowa-Based

SureHost is a Des Moines hospitality technology company that uses documented property standards, photos, video, AI-assisted review, and human judgment to check short-term rentals after cleaning. You will work with the AI Chief Architect to benchmark language and vision models against real product needs and share findings that guide model choices and the roadmap. The six-month internship is remote for Iowa residents, runs 15–20 hours per week with flexible scheduling, and pays $22–$28 per hour based on experience and independence. Start timing can accommodate school schedules; the team holds a monthly in-person check-in in Des Moines.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$22–$28/hr
  • python
  • data analysis
  • machine learning
Machine Learning & AIView job

General Translation · via Mercor

English (New Zealand) Linguistic Expert

Assess how well a large language model handles New Zealand English, then help improve its performance with carefully curated language data. You’ll review generated text for tasks such as translation, summarization, dialogue, and grammar correction, while applying your knowledge of New Zealand English to edits, annotations, and feedback for AI researchers.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • new zealand english
  • english grammar
  • english syntax
Language & LinguisticsView job

Handshake AI

Management Consultant

Use your consulting experience to help assess and improve AI-generated business content. You’ll write consulting problems grounded in real client work, review model responses for accuracy and feasibility, and provide structured feedback. The project-based, part-time work has no set schedule or minimum-hour requirement and can fit alongside your current role.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$115/hr
  • management consulting
  • corporate strategy
  • growth strategy
Business Analysis & StrategyView job

SME Careers

Maltese Language Expert

Review AI-generated Maltese and create reference answers that show accurate, natural language use. You will judge grammar, meaning, tone, register, and cultural fit, then explain errors and compare model responses using project guidelines. The role calls for native or near-native Maltese, C1-level English, and at least three years of relevant language-focused experience.

Location and eligibility
Remote · Malta only
Engagement type
Contract
Compensation
Up to $40/hr
  • maltese
  • english
  • copyediting
Language & LinguisticsView job

micro1

Preventive Cardiologist

Contribute preventive cardiology expertise to AI training and evaluation work on cardiovascular risk and long-term heart health. You will review medical content and clinical scenarios, then give evidence-based feedback. The selection process has an application, AI interview, specialty screening, and onboarding call. Prior AI experience is not required.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$80–$285/hr
  • preventive cardiology
  • cardiovascular risk assessment
  • evidence-based medicine
Healthcare & MedicalView job

Ethos

Software Engineer

Work with a foundational AI lab to train a language model on software development. You will create, assess, and refine AI-generated work across core engineering workflows. The role is remote with a flexible schedule. Work depends on client task volume, and most experts contribute fewer than 10 hours per week; hours and earnings have no weekly cap but are not guaranteed.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$100/hr
  • software engineering
  • system design
  • algorithms
Software EngineeringView job

Turing

Business Analyst (Finance)

Evaluate finance model outputs and identify performance gaps.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • corporate finance
  • investment banking
  • financial analysis
Business Analysis & StrategyView job

AfterQuery

Explosives & Energetic Materials Engineer (AI Safety)

Apply your expertise in explosives or energetic materials to assess how AI models handle safety-sensitive questions. You will create and review prompts that test the line between acceptable and unsafe requests, then document the technical basis for each decision. Applicants must hold a relevant master's degree or higher, be citizens of a Five Eyes country, and live in one of those countries while doing the work.

Location and eligibility
Remote · Eligible in 5 countries
Engagement type
Not specified
Compensation
$150/hr
  • explosives
  • energetic materials
  • chemical engineering
CybersecurityView job

Outlier · via Braintrust

Senior Media, Audio & Linguistics Experts - AI Benchmarking

Create and assess benchmarks that test AI systems against real creative and technical workflows in music, audio, speech, linguistics, visual media, or design. The work includes Linux-based tasks and domain-focused review of AI results. The project pays $1,350 per task and expects a commitment of 20 hours per week for 1–6 months.

Location and eligibility
Remote · Eligible in 25 countries
Engagement type
Contract
Compensation
$1,350 fixed
  • linux
  • ai evaluation
  • audio production
Language & LinguisticsView job

General Translation · via Mercor

Canadian English Linguistic Expert

Assess how well a large language model handles Canadian English across translation, summaries, dialogue, and grammar correction. You’ll also edit and annotate language data, flag cultural or linguistic mismatches, and share analysis with AI researchers working on model training. The project calls for strong knowledge of Canadian English, including how its usage differs from American and British English.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • canadian english
  • llm evaluation
  • linguistic annotation
Language & LinguisticsView job

Handshake AI

Reliability Engineer

Use your energy industry experience to create expert training material and assess AI-generated responses about industrial operations, plant performance, and energy asset management. The work runs on a project basis, with remote, asynchronous scheduling and no minimum hour requirement. Contributors often work 5–20 hours a week during active projects, and teams may consider them for future projects as needs arise.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • industrial operations
  • plant performance
  • energy asset management
Cloud & DevOpsView job

SME Careers

Bengali Language Expert

Review and shape Bengali content used to train AI models. You will write reference answers, compare model responses, and assess language quality, factual accuracy, tone, and cultural fit across general knowledge, customer support, education, and conversational writing. The role is remote and contract-based, with written feedback provided in English.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $15/hr
  • bengali
  • english
  • grammar
Language & LinguisticsView job

micro1

Heart Failure & Transplant Cardiologist

Use your cardiology expertise to review AI-generated information about heart failure, complex cardiovascular conditions, and advanced treatment options. You will assess clinical reasoning and offer evidence-based feedback on medical recommendations. The role calls for an MD, DO, or equivalent degree, cardiology board certification or specialist qualification, and active or recent practice in heart failure or advanced cardiovascular medicine.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$80–$285/hr
  • heart failure management
  • cardiology
  • advanced cardiovascular therapies
Healthcare & MedicalView job

Ethos

Independent Strategy & Presentation Consultant

Create, assess, and refine strategy decks and executive presentations that help train a foundational AI lab’s language model on professional presentation work. You’ll contribute across full-deck creation, storyline development, deck revisions, executive summaries, and investor or board materials. Work remotely on your own schedule; task volume varies, and most experts work fewer than 10 hours per week. Hours have no weekly cap, and the start date is ASAP.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$80/hr
  • powerpoint
  • presentation design
  • strategy decks
AI evaluationView job

Turing

SWE Bench – Data Engineer/Data Scientist

Build and validate data pipelines for AI performance evaluation projects.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • data engineering
  • data science
Data EngineeringView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.