AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Handshake AI

Security Engineer

Use your security engineering or offensive security experience to build expert training data and assess AI-generated security content. This remote, part-time contract work is project-based, with a flexible asynchronous schedule and no minimum hours. Contributors often work about 5–20 hours per week during active projects. Placement depends on project needs, with consideration for future projects as they open.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $80/hr
  • security engineering
  • offensive security
  • penetration testing
CybersecurityView job

SME Careers

JavaScript Team Lead

Guide quality across JavaScript AI training projects by reviewing code, debugging explanations, tests, and contributor work against project rubrics. You will coach trainers and QA reviewers, maintain project guidance, and flag correctness, security, and testing issues. This remote contract role has no immediate project; qualified candidates may be contacted when relevant work becomes available.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $70/hr
  • javascript
  • node.js
  • code review
Quality Assurance & TestingView job

Mercor

Audiobook QA Expert — Spanish (US)

Listen to AI-narrated audiobooks in US and North American Spanish, then assess their accuracy, naturalness, and appeal for listeners. You’ll mark speech errors and audio defects in review tools and share where the narration holds up or disrupts the listening experience. The role offers remote, part-time work at about 20 hours per week, or roughly four hours per day.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$15–$20/hr
  • spanish
  • audiobook quality assurance
  • audio annotation
Language & LinguisticsView job

AfterQuery

Audit or Assurance Accounting Expert

Create audit questions and case studies that test how AI models handle real audit work, from planning and risk assessment to controls, evidence, and fraud detection. You will assess model answers against GAAS and audit best practices, then help audit and technical specialists shape the difficulty and learning value of each challenge.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$113/hr
  • auditing
  • gaas
  • internal controls
Finance & AccountingView job

Handshake AI

Technical Writers

Use your technical writing or editorial experience to create training material and assess AI-generated documentation. You’ll review accuracy, relevance, structure, clarity, consistency, voice, and tone against professional writing standards. The work is remote, project-based, and flexible, with no minimum hours. Contributors often work about 5–20 hours per week during active projects, alongside other employment.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • technical writing
  • technical documentation
  • content creation
Technical Writing & DocumentationView job

SME Careers

Biomedical Engineering Quality Assurance Lead (QAL)

Lead quality checks for biomedical engineering AI training work, reviewing generated explanations and contributor submissions against project rubrics. You will assess technical reasoning, calculations, units, safety, and regulatory claims, then guide trainers and reviewers through feedback, onboarding, and clear documentation. The role calls for at least three years of relevant professional experience and strong written English.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $105/hr
  • biomedical engineering
  • biomechanics
  • biomaterials
Quality Assurance & TestingView job

Mercor

AI Developer Trace Task Auditor

Review coding sessions created with AI developer tools for a frontier AI lab’s model training and evaluation work. You’ll judge whether each trace reaches a correct result, follows a sound development process, and shows sound reasoning. Your written feedback should explain your assessment and follow the provided rubric.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$90/hr
  • software development
  • ai-assisted coding
  • cursor
Quality Assurance & TestingView job

AfterQuery

Technical Writer Expert

AfterQuery engages technical writers on a contract basis to help frontier AI labs improve how models explain technical systems. You will assess AI-written API references, guides, release notes, and user documentation, then create examples and evaluation data grounded in your own writing practice. The work is remote and async, with schedule and hours set by you.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$68/hr
  • technical writing
  • api documentation
  • technical documentation
Technical Writing & DocumentationView job

Turing

Senior Software Engineer – LLM Evaluation

Evaluate and refine AI-generated code for efficiency and reliability.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

SME Careers

STEM & Technical Specialist – Rubric Design

Create advanced questions in your technical discipline, assess AI-generated solutions, and build scoring criteria that capture sound reasoning as well as correct results. The work centers on rubric design, partial-credit standards, and close review of technical details such as assumptions, formulas, units, and edge cases. Applicants need a relevant degree, at least three years of domain experience, and C1-level English.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $100/hr
  • ai evaluation
  • benchmarking
  • chemistry
Quality Assurance & TestingView job

Mercor

Accounting & Audit Domain Expert

A senior accounting specialist will help a leading AI lab assess and improve how its models handle real accounting and audit work. You’ll review model outputs, write task instructions and reference solutions, and build evaluation sets with research teams. Cincinnatus LLC employs this full-time W-2 role. You must live in the Bay Area or relocate at your own cost, and work on-site multiple days each week when required. The initial engagement runs for six months at 40 hours per week.

Location and eligibility
Hybrid · United States only
Engagement type
Full-time
Compensation
$60–$100/hr
  • accounting
  • auditing
  • financial reporting
Finance & AccountingView job

AfterQuery

Scientific Computing Research Expert

Create research-grade AI evaluation tasks from computational work you have performed in your field. AfterQuery commissions tasks across life, physical, Earth, mathematical, and engineering sciences. You will define how evaluators should assess a strong solution, revise your task after expert feedback, and may also review work from other domain experts. The work follows a flexible, task-based schedule with no fixed weekly hours.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • python
  • scientific computing
  • data analysis
Science & ResearchView job

Turing

AI Quality Analyst (Personalization) - German

Evaluate AI personalization by analyzing responses based on your experiences.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • german
  • ai evaluation
  • data annotation
Quality Assurance & TestingView job

SME Careers

Malay Quality Assurance Lead (QAL)

Lead quality reviews for Malay AI training work by checking generated content and contributor output against project rubrics. You will give trainers and QAs specific feedback, clarify language questions, and maintain guidance for regional usage, tone, and terminology. The role requires professional Malay language experience and strong English; no immediate project is available, but qualified candidates may be contacted for future work.

Location and eligibility
Remote · Malaysia only
Engagement type
Contract
Compensation
Up to $25/hr
  • bahasa melayu
  • malay
  • english
Language & LinguisticsView job

AfterQuery

Creative Technologist — Audio / Design / UX

Join a research cohort of creative technology experts across audio, design, and UX. You’ll define standards for strong work by creating expert-level problems and reference materials, then judge how well frontier AI models handle them. The role centers on research and evaluation, not production engineering. Applicants need 6–10 years of experience and a bachelor’s degree; a master’s degree is a plus.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • creative technology
  • audio engineering
  • design
Design & CreativeView job

SME Careers

Legal Quality Assurance Lead (QAL)

Lead quality checks for legal AI training work by reviewing model responses and contributor submissions against project rubrics. You will guide trainers and QAs, flag legal reasoning and safety issues, and maintain resources such as calibration tasks and style guides. This remote contract has no immediate project; qualified candidates may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $120/hr
  • legal quality assurance
  • legal reasoning
  • legal research
Quality Assurance & TestingView job

AfterQuery

Compliance Officer Expert

Create and assess regulatory compliance challenges that help train AI models. You will write scenarios on topics such as regulatory interpretation, risk assessment, audits, investigations, and ethics, then review model answers for accuracy and alignment with compliance standards. The work draws on practical compliance expertise and takes place remotely with a flexible, asynchronous schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • regulatory compliance
  • regulatory frameworks
  • risk assessment
Machine Learning & AIView job

Turing

Software Engineer – AI Research & Evaluation (US-based)

Create and evaluate datasets for training large language models in Python.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

Showing 20 active roles of 113. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.