AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Handshake AI

Aerospace Engineer

Use your aerospace background to build expert-level problems and scenarios, assess AI-generated answers, and write feedback that helps improve model performance. The work draws on real design, analysis, and flight-testing practice. You can complete project-based tasks on your own schedule, with no minimum hour requirement, alongside your current role.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$75/hr
  • aerospace engineering
  • aerodynamics
  • computational fluid dynamics
EngineeringView job

Ethos

Sales Engineer / Solutions Consultant

Help train a leading foundational AI lab’s language model on professional presentation work. You’ll create, assess, and refine AI-generated slide decks for technical sales workflows, drawing on your experience building presentations as a sales engineer or solutions consultant. The role is fully remote, offers schedule flexibility, and has variable client-driven hours; most experts work fewer than 10 hours per week, with no weekly cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$80/hr
  • sales engineering
  • solutions consulting
  • powerpoint
Sales Engineering & Solutions ConsultingView job

Mercor

Technical and Scientific Sales Representative

Use your B2B technical sales experience to assess AI-generated sales content and workflows for technical and scientific products. The project starts immediately and runs for about 4–6 weeks. You must be available for at least 20 hours per week. Payment starts on a task basis after approval of your first task; completing that task within the required timeline qualifies you for hourly pay for the rest of the project.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$110/hr
  • b2b sales
  • technical sales
  • wholesale sales
Sales Engineering & Solutions ConsultingView job

AfterQuery

Technology and Professional Services Expert

Create and assess consulting challenges for AI training, drawing on experience with technology services and client engagements. You will write questions and case studies about areas such as solution architecture, vendor selection, and technology strategy, then review model answers for accuracy and alignment with professional services standards. The role also involves working with other technology experts to shape content difficulty and learning value.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$80/hr
  • technology consulting
  • professional services
  • systems integration
Sales Engineering & Solutions ConsultingView job

Handshake AI

Environmental Science Professional

Apply your environmental science expertise to an AI research project focused on how models interpret professional work and language. Project assignments may involve writing industry-specific prompts and assessing large language model responses. The program runs year-round, with projects opening at intervals; placement depends on available work. Contributors work remotely on a flexible schedule with no minimum hour commitment.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • environmental science
  • conservation science
  • environmental health
Science & ResearchView job

Ethos

Expert Success Associate

At Ethos, you’ll handle support for experts whose work helps AI labs and other frontier clients build better models. You’ll own each case from the first message through resolution, work with internal teams, and review AI-drafted replies for accuracy and empathy. The role is based at the London office near King’s Cross, with in-person work Monday through Thursday and remote work on Friday.

Location and eligibility
Hybrid · United Kingdom only
Engagement type
Contract
Compensation
Pay not listed
  • customer support
  • customer success
  • case management
Customer SupportView job

Mercor

Education & Training Expert

Mercor maintains an ongoing pool of educators for AI training and evaluation projects, rather than hiring for one active opening. Work can include creating teaching problems and reference answers, assessing model-generated lessons and explanations, and spotting content that may confuse learners. Apply with a resume, confirm where you work from, and complete an AI interview of about 20 minutes. Project invitations may arrive within a week or several months.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$30–$85/hr
  • education
  • teaching
  • tutoring
Education & TrainingView job

AfterQuery

Construction Expert

AfterQuery needs construction professionals with 1 to 3 years of experience for project-based work over the next 2 to 3 weeks. You’ll review construction documents, support planning and field problem-solving, and evaluate technical questions across different project types. Work runs asynchronously, with a 10 to 20 hour weekly commitment for each project you accept.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • construction documents
  • construction drawings
  • construction specifications
Sales Engineering & Solutions ConsultingView job

Handshake AI

Software Engineer

Help assess and improve coding agents by giving them real engineering tickets, running their work, and tracing mistakes through a codebase you know. The contract offers 40 hours each week at $6,000, paid each week, with hours you set. It renews each week when your work meets quality standards. Selection involves a proctored coding assessment and a paid trial task.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$150/hr
  • software engineering
  • code review
  • coding agents
Software EngineeringView job

Mercor

Engineering & Software Domain Expert

A senior engineering specialist will help a leading AI lab assess and improve how its models handle real software and engineering work. You will review model outputs, write task instructions and reference solutions, and create evaluation benchmarks with the research team. The position is full-time W-2 employment through Cincinnatus LLC, based in the Bay Area with on-site work multiple days each week when required.

Location and eligibility
Hybrid · United States only
Engagement type
Full-time
Compensation
$65–$105/hr
  • software engineering
  • computer science
  • distributed systems
Software EngineeringView job

AfterQuery

Special Education Teacher Expert

Create and assess special education scenarios that help AI labs evaluate model judgment. You’ll draw on your classroom experience to build cases from student evaluation through IEP implementation, explain the reasoning behind instructional decisions, and assess whether model responses meet legal and student-centered standards. The role is remote contract work with a minimum commitment of 10 hours per week and no set schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$55/hr
  • special education
  • individualized education programs
  • iep development
Education & TrainingView job

Handshake AI

Reservoir Engineer

Use your energy industry experience to create expert training material and assess AI-generated content about reservoir engineering. You’ll draw on hands-on knowledge of subsurface analysis, production operations, and relevant industry tools to judge accuracy and relevance. The work is remote, project-based, and hourly, with a flexible schedule and no minimum hour requirement. Contributors typically work about 5–20 hours per week during active projects. No AI experience is needed.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $80/hr
  • reservoir engineering
  • subsurface analysis
  • production operations
Sales Engineering & Solutions ConsultingView job

Mercor

Expert Interviewer

Support a frontier AI lab’s expert panel by interviewing shortlisted engineers for an AI training and evaluation engagement. You’ll lead structured, roughly 20-minute conversations focused on GPU kernel development, security and vulnerability research, and ML compiler and accelerator work, then share evidence-based assessments of each expert’s fit.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$50–$60/hr
  • technical interviewing
  • technical recruiting
  • gpu kernel development
Machine Learning & AIView job

AfterQuery

Consulting expert

Create and refine consulting challenges that help train AI models to handle real client work. You will build authentic business deliverables, write prompts for the analysis behind them, and assess model responses against consulting methods and standards. The role calls for at least six months of consulting experience, native English, and strong Excel and PowerPoint skills.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$125/hr
  • consulting
  • management consulting
  • strategy consulting
Business Analysis & StrategyView job

Handshake AI

Drilling Engineer

Use your drilling and energy operations experience to create expert training data and assess AI-generated answers for accuracy and relevance. The work draws on knowledge of drilling workflows, well planning, and energy data tools. It is remote and project-based, with a flexible schedule and no minimum hours. Contributors often work 5–20 hours per week during active projects; future placements depend on project needs. No AI experience is required.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • drilling operations
  • drilling engineering
  • completions
Data EngineeringView job

Mercor

Agent Engineer

Mercor seeks engineers with hands-on experience building and running LLM agents in production and direct insight into how people use them inside a company. The conversation will focus on agent reliability, evaluation, adoption, and the tradeoffs behind real systems, including internal assistants, company data and memory, tools and MCP, and visibility into agent activity and costs.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Task-based
Compensation
$500 fixed
  • llm agents
  • agent reliability
  • agent evaluation
Machine Learning & AIView job

AfterQuery

Real Estate Agent Expert

Create real estate questions and case studies for AI training, then assess model answers against practical standards and regulations. The work draws on an active real estate license and experience in practice, brokerage, or property management. You will also work with real estate and technical specialists to shape challenges that test topics such as valuation, contracts, financing, zoning, and market analysis.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • real estate
  • property valuation
  • contract negotiation
Machine Learning & AIView job

Handshake AI

Physics and Engineering Expert

Use your advanced physics training to assess AI-generated material and help improve its treatment of scientific topics. You’ll create field-specific questions and review answers for accuracy, sound reasoning, and scientific rigor. The work runs on an hourly, project basis and can fit alongside research, teaching, postdoctoral work, or industry employment. Projects are remote, with flexible scheduling and no minimum hours.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • physics
  • engineering
  • experimental methodology
EngineeringView job

Handshake AI

Security Engineer

Use your security engineering or offensive security experience to build expert training data and assess AI-generated security content. This remote, part-time contract work is project-based, with a flexible asynchronous schedule and no minimum hours. Contributors often work about 5–20 hours per week during active projects. Placement depends on project needs, with consideration for future projects as they open.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $80/hr
  • security engineering
  • offensive security
  • penetration testing
CybersecurityView job

Handshake AI

Plant Performance Engineer

Use your energy industry experience to create expert training material and assess AI-generated answers about industrial operations, plant performance, and energy asset management. The project-based work is remote, self-scheduled, and has no minimum hour requirement. Contributors typically work 5–20 hours per week during active projects, with placement based on current needs and possible consideration for future projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • industrial operations
  • plant performance
  • energy asset management
Energy & Power GenerationView job

Showing 20 active roles of 48. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.