AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

SME Careers

Chemistry Quality Assurance Lead (QAL)

Guide quality across chemistry AI training projects by reviewing generated explanations, calculations, reaction logic, and contributor work against project rubrics. You will coach trainers and QAs, resolve chemistry questions, maintain project guidance, and flag safety risks. The role calls for a relevant science degree, at least three years of related experience, and clear English communication.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $75/hr
  • chemistry
  • chemical reasoning
  • chemistry quality assurance
Quality Assurance & TestingView job

micro1

MBSE Engineer - SysML V2

As a contractor on a remote AI training and evaluation project, you’ll build SysML v2 reference models and assess models generated by AI systems. The work is task-based, with flexible hours that vary by project needs and an expected commitment of about 15 hours per week. The initial project is expected to run for roughly 4 weeks to 3 months. Applicants complete an AI interview.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$55–$120/hr
  • sysml v2
  • systems engineering
  • requirements engineering
Machine Learning & AIView job

Turing

Context and Conversation Evaluation Specialist

Review AI conversations to assess context and improve recommendations.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • conversation analysis
  • qualitative research
  • qualitative coding
Language & LinguisticsView job

AfterQuery

Finance Expert -Undergraduate / Early Career

Work remotely on part-time finance research projects that recreate analyses, models, and memos used in investment banking, private equity, and hedge funds. You’ll use Excel, PowerPoint, and financial judgment to build cases and assess AI-generated work. Projects follow a flexible, asynchronous schedule, with about 10–15 hours per week expected when work is active.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • excel
  • powerpoint
  • financial modeling
Finance & AccountingView job

Outlier · via Braintrust

Quantitative Finance AI Research Evaluator

Evaluate and help improve AI models’ handling of financial and quantitative reasoning. You’ll assess model-generated content, develop and answer specialist questions, and compare domain-specific responses. The remote contract runs through the end of June, with a possible extension. Applicants must be based in the United States, Canada, Puerto Rico, Mexico, the United Kingdom, Australia, New Zealand, or Argentina.

Location and eligibility
Remote · Eligible in 8 countries
Engagement type
Contract
Compensation
$50–$150/hr
  • quantitative finance
  • financial engineering
  • financial mathematics
Machine Learning & AIView job

Mercor

Architectural & Interior Visualization Specialist (AI Evaluation)

Create architectural and interior design tasks and reference materials that help an AI lab improve its models. The role suits an architect or senior ArchViz artist who can produce complete drawing sets, editable 3D files, and photorealistic interior and exterior renders, then assess AI outputs against real design, construction, and code standards. Cincinnatus LLC employs this full-time, 40-hour-per-week W-2 role and places you with a leading AI lab.

Location and eligibility
Remote · United States only
Engagement type
Full-time
Compensation
$70–$120/hr
  • autocad
  • revit
  • sketchup
Architecture & Urban PlanningView job

Handshake AI

Lawyers

Use your legal practice experience to shape AI research. You’ll create job-related prompts and assess AI responses for legal accuracy, reasoning, clarity, and relevance to real legal work. The work runs on an hourly, project basis with a flexible schedule and no minimum hours. Assignments open throughout the year, and placement depends on project needs.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $110/hr
  • legal analysis
  • statutory interpretation
  • case law
LegalView job

SME Careers

Medical Quality Assurance Lead (QAL)

Lead medical quality reviews across AI training projects by checking clinical content and contributor work against project rubrics. You will flag patient-safety risks, give trainers and QAs actionable feedback, and maintain review guidance and calibration materials. The role uses LLM evaluation, Discord, and Google Sheets. No project is active now; qualified experts may be contacted for future work. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $95/hr
  • medical quality assurance
  • medical review
  • clinical reasoning
Quality Assurance & TestingView job

micro1

AI Image Specialist (US Based)

Help train and evaluate AI image models by supplying original images and comparing them with generated results. You’ll identify visual flaws, assess composition and fidelity, and share clear observations through written and verbal channels. The role is for candidates based in the United States, with experience in visual arts or image evaluation considered useful.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$21–$45/hr
  • Graphic Design
  • AI Evaluation
  • Photo Editing
Machine Learning & AIView job

Turing

Endocrinologist

Evaluate AI responses for accuracy in endocrine medical scenarios.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • endocrinology
  • diabetes management
  • thyroid disorders
AI evaluationView job

AfterQuery

Finance Expert

Use your finance or accounting experience to create practical scenarios and assess how AI models handle them. AfterQuery works with AI labs on real-world finance problems across areas such as tax, financial planning, corporate finance, lending and insurance. The work takes place remotely, with flexible volume and project guidance available in the project chat after onboarding.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$175/hr
  • finance
  • accounting
  • financial planning
Finance & AccountingView job

Outlier · via Braintrust

STEM PhD Expert for AI Reasoning & Evaluation

Use your doctoral expertise to assess how AI models handle technical questions and domain-specific content. You’ll check factual accuracy and relevance, compare model responses, and contribute questions and answers in machine learning and AI. The remote contract runs through the end of June, with a possible extension based on project needs. Applicants must live in the United States, Canada, Puerto Rico, Mexico, the United Kingdom, Australia, New Zealand, or Argentina.

Location and eligibility
Remote · Eligible in 8 countries
Engagement type
Contract
Compensation
$50–$150/hr
  • machine learning
  • artificial intelligence
  • computer science
Machine Learning & AIView job

Mercor

3D Generalist: Modeling, Rigging & Animation (AI Evaluation)

Use studio experience in Blender, modeling, rigging, and animation to help improve AI training data and model performance. You’ll create production-style 3D tasks and reference assets, assess generated work, and develop quality checks. The role requires a weekday commitment of 40 hours per week. Cincinnatus LLC employs you as a W-2 employee and may place you with a leading AI lab.

Location and eligibility
Remote · United States only
Engagement type
Full-time
Compensation
$70–$120/hr
  • blender
  • python
  • bpy
Design & CreativeView job

Handshake AI

Generation Asset Analyst

Use your energy industry experience to create expert training data and assess AI-generated responses about industrial operations, plant performance, and energy asset management. The remote, project-based work has a flexible, asynchronous schedule with no minimum hours. Contributors often work about 5–20 hours per week during active projects, and placement depends on current project needs.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • industrial operations
  • plant performance
  • energy asset management
Energy & Power GenerationView job

SME Careers

Greek Language Expert

Review Greek AI responses and create reference answers that show accurate, natural writing. You will check Greek grammar, meaning, tone, cultural fit, and prompt alignment, then explain issues in written feedback. The work also involves comparing model responses and flagging factual errors, unsafe content, and reasoning problems.

Location and eligibility
Remote · Greece only
Engagement type
Contract
Compensation
Up to $25/hr
  • greek
  • english
  • copyediting
Language & LinguisticsView job

micro1

Digital Designer

As a Digital Designer, you’ll contribute original images or photographs and compare them with AI-generated versions. You’ll assess visual differences, identify image defects, and write precise feedback that helps improve AI image systems. No previous AI experience is required. The work is remote and limited to people located in the United States.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$21–$45/hr
  • image evaluation
  • Comparative ranking
  • attention to visual detail
Design & CreativeView job

Turing

JavaScript / TypeScript Full-Stack Developer

Develop and maintain high-quality JavaScript/TypeScript code for AI solutions.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • javascript
  • typescript
  • es6
Machine Learning & AIView job

AfterQuery

UI/UX Designer Expert

Create and assess design scenarios that help AI labs measure model judgment in professional design work. You’ll develop product concepts from brief to polished interface, explain the reasoning behind design critiques, and show authentic Figma workflows. The independent contractor role runs remotely and asynchronously, with ongoing project work, no fixed hours, and a minimum commitment of 10 hours per week. You can adjust your hours from week to week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$90/hr
  • ui design
  • ux design
  • figma
UX/UI & Product DesignView job

Toloka AI B.V. · via Braintrust

Licensed Physicians - Medical Content Reviewer

Review clinical EHR vignettes for a project-based medical AI evaluation program, with a focus on general and internal medicine. During active project phases, expect an estimated 10–20 hours of work per week; actual workload depends on project needs. Submit your CV in English and state your English proficiency level. The work is not permanent employment.

Location and eligibility
On-site · United States only
Engagement type
Contract
Compensation
$100/hr
  • medicine
  • clinical reasoning
  • differential diagnosis
Healthcare & MedicalView job

Mercor

Editorial, Deck & Document Designer (AI Evaluation)

Design and assess presentations, editorial layouts, documents, and print materials that help a leading AI lab improve its models. You’ll create demanding, realistic design assignments, review AI-generated work, and set quality standards for layout and typography. Cincinnatus LLC employs this full-time W-2 role and may place you with the AI lab. The commitment is 40 hours per week on weekdays.

Location and eligibility
Remote · United States only
Engagement type
Full-time
Compensation
$70–$120/hr
  • powerpoint
  • keynote
  • think-cell
Design & CreativeView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.