AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

SME Careers

STEM & Technical Specialist – Rubric Design

Create advanced questions in your technical discipline, assess AI-generated solutions, and build scoring criteria that capture sound reasoning as well as correct results. The work centers on rubric design, partial-credit standards, and close review of technical details such as assumptions, formulas, units, and edge cases. Applicants need a relevant degree, at least three years of domain experience, and C1-level English.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $100/hr
  • ai evaluation
  • benchmarking
  • chemistry
Quality Assurance & TestingView job

Energy · via Mercor

Enterprise Sales Manager – AI Training Specialist

Apply your frontline sales leadership judgment to realistic B2B scenarios that train and evaluate AI models for enterprise sales teams. You will assess deal health, pipeline quality, forecasts, and Account Executive performance, then write coaching guidance grounded in your experience. The project does not involve managing employees, carrying a quota, or working with customers.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$100–$125/hr
  • enterprise sales
  • b2b sales
  • sales management
Sales & Business DevelopmentView job

micro1

Specialist

Help assess how AI models handle federal procurement work by creating realistic contracting tasks, reviewing model responses, and supplying expert feedback. The work spans the acquisition lifecycle, from pre-award planning and solicitation through negotiation and post-award administration. The role is listed for applicants in the United States and focuses on federal contracting expertise.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$60–$80/hr
  • Federal Contracting
  • Contract Negotiation
  • Pre-Award and Post-Award Procedures
Talent Acquisition & RecruitingView job

AfterQuery

Security Engineer — Cryptanalysis / Reverse Engineering

AfterQuery is assembling senior security experts to assess how frontier AI models handle difficult, real-world problems in cryptanalysis and reverse engineering. You will define what strong reasoning and correct answers look like through research and evaluation work, rather than production engineering. The role calls for 6–10 years of experience and a bachelor's degree; a master's degree is preferred.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • security
  • cryptanalysis
  • reverse engineering
CybersecurityView job

Handshake AI

Engineering Expert

The year-round Handshake AI Fellowship brings engineering specialists into project-based work that helps improve large language models in expert fields. You’ll create subject-specific prompts, assess model responses, and research topics with AI. Work remotely on your own schedule for about 10 to 20 hours each week; project placement depends on availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $75/hr
  • industrial engineering
  • mechanical engineering
  • aerospace engineering
Machine Learning & AIView job

Ethos

Strategy Consultant

Help a leading foundational AI lab train its latest language model on professional presentation work. You will create, assess, and refine AI-generated presentations and slide decks across strategy consulting workflows. Work remotely on your own schedule; client task volume determines available hours, and most experts work under 10 hours a week. The role has no weekly hours cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$80/hr
  • strategy consulting
  • powerpoint
  • storylining
Business Analysis & StrategyView job

Turing

Real Estate Concierge Specialist

Apply your background in property management, real estate operations, or community administration to projects that test and improve AI. You will create property and concierge scenarios, write structured solutions, and assess AI responses. No AI experience is needed. The work is fully remote, with freelance projects expected to last about one month and possible extensions.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • property management
  • community management
  • real estate operations
Sales Engineering & Solutions ConsultingView job

SME Careers

Customer Service (Call Center) Expert

Use your call center expertise to shape natural conversations for speech-to-speech AI agents. You will act out customer support scenarios, assess and rank model responses, and check outputs for inaccuracies or bias. The role requires at least two years in customer service, one year in AI training, and C1+ spoken English; the English requirement is limited to US candidates.

Location and eligibility
Remote · Canada, United States
Engagement type
Contract
Compensation
Up to $30/hr
  • ai training
  • call center
  • customer service
Customer SupportView job

Mercor

Mechanical Engineer Reviewer

Reviewers help assess AI evaluation material for enterprise product design and manufacturing. You will check technical scenarios, reference answers, and grading rubrics against either the US ASME track, the international ISO track, or both. The work reflects the design complexity, safety demands, and production scale found at Fortune 500 companies and large industrial manufacturers.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$90/hr
  • mechanical engineering
  • asme
  • iso
EngineeringView job

micro1

Independent Professional & Solopreneur (Domain Expert)

Independent professionals and solopreneurs will apply their domain knowledge to assess real-world work and improve AI training materials. The project focuses on how AI handles practical tasks, including proposals, reports, client communications, and analyses. Prior AI experience is not needed. The role is remote and open to people in the US and Canada.

Location and eligibility
Remote · Canada, United States
Engagement type
Contract
Compensation
$40–$120/hr
  • domain-expertise
  • client-relationship-management
  • written-communication
Machine Learning & AIView job

AfterQuery

Customer Service Representative Expert

Create customer support scenarios that test how AI models handle real-world interactions and service decisions. You will assess model answers against customer service standards and give detailed feedback, drawing on experience with support operations and best practices. The role is remote and asynchronous, with a flexible schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$55/hr
  • customer service
  • customer support operations
  • conflict resolution
Customer SupportView job

Handshake AI

Civil Engineering Expert

Use your civil or structural engineering experience to assess AI-generated engineering work. You’ll write realistic problems based on design, modeling, estimating, and project work, then check model responses for technical accuracy and practical feasibility. The ongoing work is project-based, part-time, and self-scheduled, with no minimum hour requirement.

Location and eligibility
Remote · Canada, United States
Engagement type
Part-time
Compensation
$62.5/hr
  • civil engineering
  • structural engineering
  • engineering design
EngineeringView job

Ethos

Revenue/GTM Operations Specialist

Use your revenue and CRM operations expertise to help train a language model from a foundational AI lab. You will create, assess, and refine professional documents, spreadsheets, and slide decks for core GTM workflows, including field mapping, lead routing, territory models, pipeline audits, funnel dashboards, and data deduplication.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100/hr
  • revenue operations
  • gtm operations
  • crm operations
Sales & Business DevelopmentView job

Turing

Real Estate Sales Agent

Use your real estate brokerage experience to help assess and improve AI systems. You will create property and negotiation scenarios, write structured solutions, and review model responses for accuracy, professionalism, and compliance. The work draws on knowledge of valuation, client consultations, closing processes, and buyer-seller dynamics. Prior AI experience is not required.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • real estate brokerage
  • real estate sales
  • deal negotiation
Sales Engineering & Solutions ConsultingView job

Mercor

Wholesale and Manufacturing Sales Representative

Use your background in B2B wholesale and manufacturing sales to assess AI-generated sales content and workflows. The project starts immediately and runs about 4–6 weeks. You can work remotely and must commit at least 20 hours per week. Payment starts on a task basis after approval of your first task; completing that task within the required timeline qualifies you for hourly pay for the rest of the project.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$110/hr
  • b2b sales
  • wholesale sales
  • manufacturing sales
Sales & Business DevelopmentView job

AfterQuery

Professional Engineer Expert

AfterQuery engages licensed engineers to create and assess scenarios that test how AI models handle professional engineering decisions. You will build examples spanning design, review, and approval, then explain the code and safety considerations behind sound answers. The work is remote and asynchronous, with a minimum commitment of 10 hours per week.

Location and eligibility
Remote · United States only
Engagement type
Not specified
Compensation
$148/hr
  • professional engineering
  • professional engineer license
  • design review
Sales Engineering & Solutions ConsultingView job

Handshake AI

Completions Engineer

Apply your energy industry experience to create expert training data and assess AI-generated content about drilling and completions work. The project runs remotely with a flexible, asynchronous schedule and no minimum hours. Contributors often work 5–20 hours per week during active projects, and placement depends on current project needs, with future projects also possible.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • drilling operations
  • completions
  • well planning
Data EngineeringView job

Ethos

Special Education Specialist / IEP Consultant

Help train a language model for a foundational AI lab by creating, reviewing, and refining professional documents, spreadsheets, and slide decks for special education workflows. Work remotely on your own schedule, with a start date as soon as possible. Task volume varies, and most experts work under 10 hours per week; hours are not guaranteed, with no weekly cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$90/hr
  • special education
  • individualized education programs
  • iep writing
Education & TrainingView job

Mercor

Software Engineer — Agentic Search Systems

Bring your experience shipping search systems into a 25-minute conversation about search quality, evaluation, and the tradeoffs behind real implementations. The interview has no coding or take-home exercise. Candidates whose interviews stand out may be invited to a paid, 30-minute live conversation with the team; payment follows completion of the call.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Task-based
Compensation
$150 fixed
  • search systems
  • agentic search
  • information retrieval
Sales Engineering & Solutions ConsultingView job

AfterQuery

Science Teacher Expert

AfterQuery engages science teachers as independent contractors to create and assess scenarios that AI labs use to evaluate model judgment. You will write classroom-ready examples, provide answer explanations, and review model responses for scientific accuracy and lab safety. The work runs remotely on an asynchronous schedule, with ongoing project assignments and a minimum commitment of 10 hours each week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$60/hr
  • science education
  • biology
  • chemistry
Science & ResearchView job

Showing 20 active roles of 48. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.