AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Pearson · via Mercor

US Contract Attorney — Litigation

Join an evergreen pool for legal AI projects that train models with litigation examples. You will compare AI-generated legal work, explain which response better applies the source documents and US law, and create realistic litigation tasks with reference answers. Apply once for consideration as projects launch. Work takes place remotely, with flexible hours and recurring assignments when new work becomes available.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$100–$120/hr
  • litigation
  • civil litigation
  • commercial litigation
LegalView job

SME Careers

Greek Team Lead

Guide quality and contributor performance across Greek AI training projects. You will review Greek-language content and trainer work against project rubrics, then give clear feedback on accuracy, grammar, tone, cultural fit, and instruction-following. The role also covers LLM evaluation, contributor onboarding, quality documentation, and coordination with trainers and QAs in English.

Location and eligibility
Remote · Greece only
Engagement type
Contract
Compensation
Up to $30/hr
  • greek
  • modern greek
  • english
Language & LinguisticsView job

Pearson · via Mercor

US Contract Attorney — In-House Counsel

Join an evergreen pool of experienced US in-house counsel supporting a leading AI lab’s legal reasoning projects. Work may include comparing AI-generated legal responses, explaining which answer better reflects source materials and US law, and building realistic legal tasks with reference answers. Projects arise on an ongoing basis, with remote work, flexible hours, and recurring assignments as new work launches.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$100–$120/hr
  • contract review
  • compliance
  • employment law
LegalView job

SME Careers

Hungarian Team Lead

Lead quality checks across Hungarian AI training projects by reviewing generated content and contributor work against project rubrics. You will guide trainers and QA reviewers, resolve language questions, maintain Hungarian-specific documentation, and support onboarding and contributor activation. The contract is remote, and the work calls for native or near-native Hungarian plus clear English communication using tools such as Discord and Google Sheets.

Location and eligibility
Remote · Hungary only
Engagement type
Contract
Compensation
Up to $30/hr
  • hungarian
  • english
  • hungarian grammar
Language & LinguisticsView job

Pearson · via Mercor

US Contract Attorney — Transactional

Join an evergreen pool for legal AI projects that assess and improve model performance on transactional work. You’ll compare AI-generated legal materials, explain your judgments, and create prompts and reference answers based on your practice. The role offers remote work and flexible hours, with recurring assignments as projects launch and applications considered on a rolling basis.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$100–$120/hr
  • transactional law
  • contract drafting
  • contract redlining
LegalView job

SME Careers

Data Scientist

Review AI-generated data science reasoning, code, and model results, then create reference solutions that show sound quantitative methods. You will check statistical claims, modeling decisions, and prompt compliance, and compare answers for correctness and clarity. The work draws on Python, scikit-learn, and SQL expertise. This contract has no immediate project; qualified candidates may hear about future assignments.

Location and eligibility
Remote · Germany, India, United States
Engagement type
Contract
Compensation
Up to $100/hr
  • data science
  • python
  • pandas
Data Science & AnalyticsView job

Pearson · via Mercor

US Contract Attorney — Federal Litigation

Reviewers will help an AI lab assess legal reasoning by comparing two motion briefs for the same case. You will choose the stronger brief, score both against set criteria, and mark errors in the PDFs. The project calls for about 30–40 hours of work within a one-week review window, with a short onboarding session before work begins. The project requires every reviewer to complete the full set.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$110–$125/hr
  • federal litigation
  • motion briefs
  • legal reasoning
LegalView job

SME Careers

Blender Specialist

Create realistic Blender assignments that test professional 3D workflows, then record your own work with the provided capture tools. You will document reproducible steps and define clear checks for meshes, scenes, and renders, helping train and evaluate AI agents on desktop software. The contract requires a Blender-capable computer running Windows 11, Ubuntu (X11), or macOS, plus B2 English proficiency.

Location and eligibility
Remote · Eligible in 31 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • blender
  • 3d modeling
  • topology
Design & CreativeView job

Mercor

Excel Expert — General

Use broad, advanced Excel experience to help improve how AI models handle spreadsheet work. You will create realistic tasks and solutions, assess model responses, and give research teams feedback across business domains. Cincinnatus LLC employs this W-2 role and may place you within a leading technology company’s GenAI initiative. The schedule calls for 40 weekday hours per week through the end of September, then 20 hours per week.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$100/hr
  • microsoft excel
  • xlookup
  • index/match
Machine Learning & AIView job

SME Careers

Architecture and Design Quality Assurance Lead (QAL)

Guide quality across architecture, interior design, urban design, and built-environment AI training projects. You will assess AI-generated design content and contributor reviews against project rubrics, coach trainers and QAs, and maintain review guidance and calibration materials. The role is remote and contract-based, with no immediate project assignment; qualified experts may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $75/hr
  • architecture
  • interior design
  • urban design
Architecture & Urban PlanningView job

Mercor

Medical Expert

Mercor keeps a standing pool of clinicians and health professionals for AI training and evaluation projects. You may write clinical cases with reference answers, assess model reasoning, and identify recommendations that overlook a patient's circumstances or care setting. After you submit a resume, confirm where you work from, and complete an AI interview of about 20 minutes, Mercor verifies your credentials and may contact you when a project fits your background.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$180/hr
  • clinical reasoning
  • case writing
  • clinical evaluation
Healthcare & MedicalView job

SME Careers

Economics Quality Assurance Lead (QAL)

Lead quality checks for economics-focused AI training work, reviewing generated explanations, calculations, graphs, and policy analysis against project rubrics. You will coach trainers and QAs, maintain review guidance, and flag weak assumptions or misleading claims. Strong knowledge of econometrics and economic analysis, plus clear written English, will help you align remote contributors around consistent standards.

Location and eligibility
Remote · India, United States
Engagement type
Contract
Compensation
Up to $90/hr
  • economics
  • econometrics
  • economic analysis
Quality Assurance & TestingView job

Mercor

Frontend Engineer Talent Network

Apply to Mercor’s network for potential contract projects with AI labs and companies. After you complete your profile and pass an AI interview, Mercor may match you with projects as they open. Work can include training and evaluating AI models, developing frontend tasks based on real scenarios, and giving domain feedback for AI research. Projects vary in length and scope, with commitments often around 15–30 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70–$150/hr
  • javascript
  • react
  • vue
Machine Learning & AIView job

SME Careers

Assamese Language Expert

Create reference answers in Assamese and assess AI-generated responses across general knowledge, customer support, education, and conversational writing. You will judge meaning, grammar, tone, cultural fit, and prompt adherence, then explain issues in English. The role requires native or near-native Assamese, C1 English, and at least three years of relevant language work.

Location and eligibility
Remote · Bangladesh, Bhutan, India
Engagement type
Contract
Compensation
Up to $15/hr
  • assamese
  • english
  • assamese grammar
Language & LinguisticsView job

Mercor

Clinical Medicine Domain Expert

Use your clinical judgment to help a leading AI lab assess and improve how its models handle real medical work. You will review clinical tasks and model responses, write instructions and reference solutions, and develop evaluation benchmarks with research teams. The full-time W-2 role runs through Cincinnatus LLC, places you with the client team, and requires a Bay Area home base with on-site work multiple days each week.

Location and eligibility
Hybrid · United States only
Engagement type
Full-time
Compensation
$70–$110/hr
  • clinical medicine
  • clinical practice
  • medical diagnosis
Healthcare & MedicalView job

SME Careers

Indonesian Language Expert

Review AI-generated Bahasa Indonesia and create reference answers that demonstrate accurate, natural writing. You will assess grammar, meaning, tone, cultural fit, and prompt adherence, then explain quality issues in English. This hourly contract role has no active project at present; qualified experts may receive invitations to relevant work through the expert network.

Location and eligibility
Remote · Indonesia only
Engagement type
Contract
Compensation
Up to $20/hr
  • indonesian
  • bahasa indonesia
  • english
Language & LinguisticsView job

Mercor

Software Engineer – Retail Investing Platforms (Paid Expert Interview)

Mercor seeks experienced engineers at companies that serve retail investors for a paid, one-time interview with a leading AI company building financial intelligence products. In a 45–60 minute remote conversation, you’ll explain how your team evaluates and selects third-party APIs or AI vendors, then share what shaped the integration and vendor experience. The interview covers your own views, not confidential employer information.

Location and eligibility
Remote · Eligible in 33 countries
Engagement type
Hourly
Compensation
$120 fixed
  • software engineering
  • backend engineering
  • api integration
AI evaluationView job

SME Careers

Mandarin Quality Assurance Lead (QAL)

Lead quality checks for Traditional Chinese AI training work aimed at Taiwan users. You will assess generated content and reviewer output against project rubrics, guide contributors on Taiwan Mandarin usage, and maintain practical quality documentation. The role is remote and contract-based, with no immediate project assigned; qualified experts may be contacted when suitable work becomes available.

Location and eligibility
Remote · Taiwan only
Engagement type
Contract
Compensation
Up to $45/hr
  • traditional chinese
  • taiwan mandarin
  • chinese quality assurance
Language & LinguisticsView job

Boron · via Mercor

Pediatrician (MD)

A healthcare AI partner is developing clinical documentation tools and needs a pediatrician to assess their medical accuracy and usefulness. You’ll review patient charts, compare AI-generated summaries with clinical expectations, and annotate encounter data. The work requires a US-based MD with a pediatric background and at least 10 hours of availability each week through mid-November.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$150/hr
  • pediatrics
  • clinical documentation
  • patient charts
Healthcare & MedicalView job

SME Careers

Tamil Team Lead with Mathematical Background

Guide Tamil quality across AI training projects by reviewing contributor work and AI-generated content against project rubrics. You will coach trainers and QA reviewers, resolve language questions, and maintain practical reference materials. The role calls for a mathematics degree, advanced Tamil and English, and at least three years in Tamil language or review work; the engagement is remote and contract-based.

Location and eligibility
Remote · Eligible in 4 countries
Engagement type
Contract
Compensation
Up to $25/hr
  • tamil
  • english
  • mathematics
Language & LinguisticsView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.