AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

AfterQuery

Professional Engineer Expert

AfterQuery engages licensed engineers to create and assess scenarios that test how AI models handle professional engineering decisions. You will build examples spanning design, review, and approval, then explain the code and safety considerations behind sound answers. The work is remote and asynchronous, with a minimum commitment of 10 hours per week.

Location and eligibility
Remote · United States only
Engagement type
Not specified
Compensation
$148/hr
  • professional engineering
  • professional engineer license
  • design review
Sales Engineering & Solutions ConsultingView job

Turing · via Braintrust

Quality & Patient Safety Nurse - AI Evaluation

Use your quality and patient safety nursing expertise to build clinical cases and assess AI responses. You will work remotely as a US-based contractor on a 12-week project, with a target start date of November 2, 2026. Choose 20 or 40 hours per week and plan for four hours of overlap with Pacific working hours. Selection involves an application review and assessment.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$65/hr
  • quality improvement
  • patient safety
  • infection prevention
Quality Assurance & TestingView job

Mercor

Business Operations / Knowledge Work Specialist

Bring business operations and professional knowledge-work expertise to AI training. You’ll create and assess realistic business tasks, workflows, and reference materials, then give research and engineering teams feedback that helps improve model performance. Cincinnatus LLC employs this part-time role on a W-2 basis and may place you within a leading AI lab’s extended workforce. You must be available at least 20 hours each week on weekdays.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$50–$80/hr
  • business operations
  • strategy
  • program management
Business Analysis & StrategyView job

Handshake AI

Environmental Science Professional

Apply your environmental science expertise to an AI research project focused on how models interpret professional work and language. Project assignments may involve writing industry-specific prompts and assessing large language model responses. The program runs year-round, with projects opening at intervals; placement depends on available work. Contributors work remotely on a flexible schedule with no minimum hour commitment.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • environmental science
  • conservation science
  • environmental health
Science & ResearchView job

SME Careers

Biologist

Use your biology expertise to assess AI-generated explanations, compare proposed solutions, and write accurate model answers across biological topics. You will check scientific claims against public sources and flag errors in reasoning, methods, or prompt adherence. This contract role has no immediate project; qualified experts may hear about relevant work through the expert network.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $70/hr
  • biology
  • cell biology
  • molecular biology
Science & ResearchView job

micro1

Member of Technical Staff, Realm Lab (frontier AI research)

Realm Lab needs a Member of Technical Staff to evaluate and improve frontier AI systems. You’ll work across machine learning, data research, and evaluation engineering, building benchmarks, reinforcement learning environments, and datasets. The role calls for hands-on experience with LLM evaluation, Python, and experimental methods, plus the ability to turn real-world workflows into structured tests of model capabilities.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$100–$130/hr
  • LLM Evaluation & Benchmark Design
  • Python & ML Engineering
  • Reinforcement Learning & Agentic Systems
Machine Learning & AIView job

Ethos

Investor Relations Associate

Help a leading foundational AI lab train its language model on professional investor relations presentations. Create, assess, and refine AI-generated decks across storyline development, executive summaries, slide structure, data-driven exhibits, and client-ready production. Work remotely on your own schedule, with hours tied to client task volume; most experts work under 10 hours per week, and weekly hours are not guaranteed.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100/hr
  • investor relations
  • powerpoint
  • presentation design
Developer RelationsView job

Turing

Employment & Labor Law Expert

Evaluate AI responses to U.S. employment law scenarios for accuracy.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • employment law
  • labor relations
  • workplace compliance
LegalView job

AfterQuery

History Expert

AfterQuery contracts historians to create and evaluate scenarios that help AI labs test historical judgment. You’ll work in your period or regional specialty, building exercises around primary sources, writing evidence-based reference answers, and assessing model responses. The work runs remotely and asynchronously, with a minimum commitment of 10 hours per week and no fixed schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • history
  • historical research
  • source criticism
AI evaluationView job

Turing · via Braintrust

Clinical Social Worker - AI Evaluation

Use your clinical social work expertise to build realistic cases and assess AI responses in hospital social work, behavioral health, psychosocial safety, and discharge planning. The remote contract is open to US-based professionals and is expected to run for 12 weeks, starting November 2, 2026. Choose 20 or 40 hours per week, with four hours overlapping Pacific working hours. Pay is $38 per hour; selection includes an application review and assessment.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$38/hr
  • clinical social work
  • hospital social work
  • behavioral health
Healthcare & MedicalView job

Mercor

Creative & Media Expert

Create evaluation tasks that test whether AI systems can deliver work at the level a senior creative professional would provide to a client, employer, or audience. You will develop briefs and source materials, create reference work, then assess AI outputs for content and craft. The work spans enterprise communications, entertainment, marketing, visual design, and interactive digital products.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$80–$90/hr
  • creative brief writing
  • creative evaluation
  • ai evaluation
Design & CreativeView job

Handshake AI

Biology Expert

Use your biology expertise on remote, project-based work that helps improve AI responses. You’ll create questions grounded in the field and assess model answers for accuracy, scientific reasoning, experimental design, and technical problem-solving. The schedule is flexible, with no minimum hours; contributors often work about 5–20 hours per week during active projects. Project placement depends on current needs, with future projects also possible.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$125/hr
  • biology
  • experimental design
  • experimental methodology
Science & ResearchView job

SME Careers

Life & Environmental Sciences Team Lead

Lead quality checks for AI training work across biology, ecology, environmental science, and related life sciences. You will assess scientific content against project rubrics, coach trainers and QAs, maintain review documentation, and flag risks such as unsupported environmental claims or unsafe recommendations. The role calls for native Punjabi fluency, strong English communication, and at least three years of relevant scientific experience.

Location and eligibility
Remote · India only
Engagement type
Contract
Compensation
Up to $20/hr
  • biology
  • ecology
  • environmental science
Science & ResearchView job

micro1

Employment Lawyer

As an Employment Lawyer on a project to improve AI legal reasoning, you’ll assess employment law scenarios and review AI-generated analyses, arguments, and documents. Your legal judgment and written feedback will help identify errors and gaps and guide improvements to model outputs. Applicants must be based in the US, hold a U.S. law degree, and have an active bar license.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$170/hr
  • employment law expertise
  • legal analysis
  • legal document review
LegalView job

Ethos

Equity Research Analyst

Help train a language model from a foundational AI lab by building and reviewing professional equity research presentations. You’ll create, evaluate, and refine slides for research reports, earnings coverage, industry analysis, investment theses, valuation summaries, and investor meetings. Work remotely on your own schedule; client task volume varies, and most experts work under 10 hours per week, with no weekly hour cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100/hr
  • equity research
  • sell-side research
  • independent research
Machine Learning & AIView job

Turing

AI Quality Analyst (Personalization) - Hindi

Evaluate Hindi AI responses using personal context for relevance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • hindi
  • prompt engineering
  • ai evaluation
AI evaluationView job

AfterQuery

Patent Agent Expert

At AfterQuery, you’ll create and assess patent prosecution scenarios that help AI labs evaluate model judgment. The work draws on your experience with claim drafting, prior art analysis, and office action responses. You’ll write reference answers that explain your legal and technical reasoning, then judge model responses for accuracy and flag drafting that would not hold up at the USPTO.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$108/hr
  • patent prosecution
  • claim drafting
  • office action responses
LegalView job

Turing · via Braintrust

Utilization Management Nurse - AI Evaluation

Use your utilization management nursing expertise to build clinical cases and assess AI responses. This remote contract project is open to US-based professionals and is expected to run for 12 weeks, starting November 2, 2026. Choose 20 or 40 hours per week, with four hours of overlap with Pacific working hours. Selection includes an application review and assessment.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$38/hr
  • utilization management
  • nursing
  • prior authorization
Health Informatics & Medical RecordsView job

Mercor

Music Producer & Audio Post Specialist (AI Evaluation)

Score, mix and master commercial music and audio post for broadcast and digital ads while helping a leading AI lab improve its models and training data. You will assess generated music, voice-over and sound design, build practical evaluation tasks, and create rights-cleared reference files. The remote, full-time W-2 role requires 40 hours per week on weekdays and employs you through Cincinnatus LLC.

Location and eligibility
Remote · United States only
Engagement type
Full-time
Compensation
$70–$120/hr
  • commercial music production
  • audio post-production
  • music composition
Design & CreativeView job

Handshake AI

GIS Analyst

Use your energy-sector experience in environmental assessment, GIS analysis, or renewable energy siting to create training data and review AI-generated content. You’ll assess accuracy and relevance, then give feedback on environmental workflows and geospatial data practices. The work is remote and project-based, with a flexible schedule, no minimum hours, and about 5–20 hours per week during active projects. Placement depends on project needs, with future projects also possible.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • environmental analysis
  • environmental assessment
  • gis
Data Science & AnalyticsView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.