AIWorkJobs

Job index

Quality Assurance & Testing jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

SME Careers

STEM & Technical Specialist – Rubric Design

Create advanced questions in your technical discipline, assess AI-generated solutions, and build scoring criteria that capture sound reasoning as well as correct results. The work centers on rubric design, partial-credit standards, and close review of technical details such as assumptions, formulas, units, and edge cases. Applicants need a relevant degree, at least three years of domain experience, and C1-level English.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $100/hr
  • ai evaluation
  • benchmarking
  • chemistry
Quality Assurance & TestingView job

Mercor

Software Engineer — Agentic Search Systems

Bring your experience shipping search systems into a 25-minute conversation about search quality, evaluation, and the tradeoffs behind real implementations. The interview has no coding or take-home exercise. Candidates whose interviews stand out may be invited to a paid, 30-minute live conversation with the team; payment follows completion of the call.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Task-based
Compensation
$150 fixed
  • search systems
  • agentic search
  • information retrieval
Sales Engineering & Solutions ConsultingView job

micro1

Dimensional Metrology Quality Engineer

A contractor will review 3D scan-based first-article inspection reports for a project developing AI systems. The work covers scan-to-CAD comparisons, datum setups, profile and position callouts, and CMM measurement with uncertainty analysis. You will assess whether deviations reflect the part or result from fixturing and alignment, then provide input for FAI sign-off decisions. Prior AI experience is not required.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$50–$100/hr
  • GD&T and first-article inspection
  • 3D scanning and inspection software
  • CMM measurement and uncertainty analysis
Quality Control & InspectionView job

AfterQuery

Psychologist Expert

Create and evaluate clinical scenarios that help frontier AI labs assess model judgment and safety. You will write realistic vignettes and reference responses, then review model answers for clinical accuracy, ethics, and risk handling. The role suits a licensed psychologist with at least two years of post-licensure practice and a commitment of 10 or more hours per week. Work is remote, asynchronous, and contractor-based, with no caseload.

Location and eligibility
Remote · United States only
Engagement type
Not specified
Compensation
$123/hr
  • psychology
  • clinical assessment
  • psychotherapy
Healthcare & MedicalView job

Turing

Software Engineer – AI Research & Evaluation (US-based)

Create and evaluate datasets for training large language models in Python.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

SME Careers

Malay Quality Assurance Lead (QAL)

Lead quality reviews for Malay AI training work by checking generated content and contributor output against project rubrics. You will give trainers and QAs specific feedback, clarify language questions, and maintain guidance for regional usage, tone, and terminology. The role requires professional Malay language experience and strong English; no immediate project is available, but qualified candidates may be contacted for future work.

Location and eligibility
Remote · Malaysia only
Engagement type
Contract
Compensation
Up to $25/hr
  • bahasa melayu
  • malay
  • english
Language & LinguisticsView job

Mercor

Software Engineering Expert

Use your production software experience to help assess AI models through engineering problems and code reviews. Work may cover frontend, backend, full-stack, mobile, embedded, DevOps, systems, QA, or security engineering. This ongoing candidate pool stays open between projects; after background verification, matching candidates may receive project invitations on timelines that range from a week to several months.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70–$150/hr
  • software engineering
  • frontend development
  • react
Software EngineeringView job

micro1

Elevator Mechanic / Adjuster (QEI, Controller Troubleshooting)

Contribute elevator trade expertise to a customer project that helps train AI systems. You’ll review controller and safety-circuit troubleshooting cases, assess diagnostic reasoning and code references, and provide written and verbal feedback on hydraulic and traction equipment. No previous AI experience is needed; the work calls for practical elevator knowledge.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$20–$60/hr
  • Controller troubleshooting from straight-line wiring diagrams
  • ASME A17.1 code and safety circuits
  • Adjusting and testing (hydraulic and traction)
Quality Assurance & TestingView job

AfterQuery

Actuary Expert

Review AI-generated actuarial work for technical accuracy, develop examples of pricing, reserving, and risk modeling, and assess model answers against actuarial standards of practice. The role suits actuaries with a professional credential or substantial exam progress and at least two years of relevant experience. Work takes place remotely on an asynchronous schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$115/hr
  • actuarial science
  • pricing
  • reserving
Finance & AccountingView job

Turing

AI Benchmark & Red-Teaming Specialist

Research and build benchmark tasks to expose AI model weaknesses.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • large language models
  • ai benchmarking
  • red teaming
Machine Learning & AIView job

SME Careers

Legal Quality Assurance Lead (QAL)

Lead quality checks for legal AI training work by reviewing model responses and contributor submissions against project rubrics. You will guide trainers and QAs, flag legal reasoning and safety issues, and maintain resources such as calibration tasks and style guides. This remote contract has no immediate project; qualified candidates may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $120/hr
  • legal quality assurance
  • legal reasoning
  • legal research
Quality Assurance & TestingView job

Mercor

AWS Serverless & Infrastructure-as-Code Task Auditor

Review AWS serverless and infrastructure-as-code tasks that help train and evaluate a frontier AI lab’s models. You’ll check multi-service designs, confirm that IaC matches the intended architecture, and assess how services integrate. Your reviews should address cloud architecture and technical correctness, with clear written feedback tied to a rubric. The role is open to candidates in the United States.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$90/hr
  • aws lambda
  • api gateway
  • dynamodb
Cloud & DevOpsView job

micro1

Member of Technical Staff, Coding Agent Research & Evaluations

Shape how frontier coding agents are tested and improved. You will create evaluation methods, datasets, and tools, then study model performance across software engineering tasks. The work combines Python and software engineering, LLM and agent systems, benchmark design, and model failure analysis. You will also share research findings with technical and client audiences.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$8–$9/hr
  • Coding Agent Evaluation & Benchmark Design
  • Software Engineering & Python
  • LLM & Agentic Systems
Machine Learning & AIView job

AfterQuery

Audio and Video Technician Expert

Create and assess technical challenges that test how AI models handle real-world audiovisual production. You will draw on experience with equipment operation, troubleshooting, and production workflows to check model answers against technical standards and established practices. The work centers on audio and video production topics, from signal flow and microphone use to camera operation and live streaming.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$55/hr
  • audio production
  • video production
  • broadcast operations
Machine Learning & AIView job

SME Careers

HTML/CSS Team Lead

Guide quality across HTML/CSS AI training work by reviewing generated code and contributor evaluations against project rubrics. You will assess semantics, accessibility, responsive behavior, browser support, and CSS structure, then give actionable feedback and maintain resources for remote contributors. The role requires at least three years of relevant frontend experience and strong English communication.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $80/hr
  • html
  • css
  • web accessibility
Quality Assurance & TestingView job

Mercor

Audiobook QA Expert — English (US)

Listen to AI-generated audiobooks in US and North American English and assess whether the narration sounds natural, accurate, and enjoyable. You’ll mark speech and audio issues in review tools, identify where the listening experience falters, and rate listener satisfaction. The role calls for native or near-native English fluency, regular audiobook listening, and availability for about 20 hours each week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$20–$25/hr
  • audiobook quality assurance
  • audio annotation
  • speech evaluation
Language & LinguisticsView job

micro1

Strategic Project Lead, AI Coding & Evaluations

Lead the delivery of coding data pipelines that support training frontier AI models. You’ll work with AI Lab clients, software engineering experts, reviewers, MTS, and internal teams to set quality standards, manage delivery, and improve workflows. The role calls for software engineering knowledge, experience leading technical projects or complex data workflows, and confidence translating client needs into clear specifications.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$80–$90/hr
  • Technical Project & Pipeline Management
  • Software Engineering & Technical Fluency
  • Workflow Automation & Operational Excellence
Machine Learning & AIView job

AfterQuery

Software Engineering Expert

Take on project-based engineering work over the next 2–3 weeks, with an expected 10–20 hours per week for projects you accept. You’ll develop and debug software, review code, and handle technical implementation across varied stacks and applications. The work suits engineers with 1–3 years of professional experience who can scope and deliver features independently.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • software engineering
  • data structures
  • algorithms
Software EngineeringView job

Showing 20 active roles of 210. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.