AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Confidential employer · via Braintrust

EU Regulatory Reporting Specialist – AI Evaluation

Use your experience with EU regulatory returns to create practical cases that test AI on reporting decisions. You’ll build scenarios for fictional banks, insurers, or other firms, then work through large datasets with spreadsheets and Python to check calculations and confirm the correct template values under the rules in force on a given reporting date.

Location and eligibility
Remote · Eligible in 28 countries
Engagement type
Contract
Compensation
$75–$90/hr
  • regulatory reporting
  • data validation
  • microsoft excel
Enterprise Systems (ERP/CRM)View job

Mercor

Scientific / ML Engineer

Work on AI training data by creating and reviewing technical problems in machine learning and scientific computing. You will assess model training, experiments, data pipelines, and simulations, then provide solutions and feedback grounded in sound methodology. Cincinnatus LLC employs this part-time W-2 role and may place you with a leading AI lab as part of its extended workforce.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$90–$140/hr
  • machine learning
  • scientific computing
  • python
Machine Learning & AIView job

Handshake AI

French AI Evaluation Specialist (US / Canada)

Use your French fluency and real-world experience with AI tools to compare and rank generated responses. You’ll explain your preferences in writing so future models can tailor answers to individual users. The work runs on an ongoing, project-based basis, with no fixed schedule or minimum hours, and you can fit tasks around your current role.

Location and eligibility
Remote · Canada, United States
Engagement type
Part-time
Compensation
$40/hr
  • french
  • english
  • ai response evaluation
AI evaluationView job

SME Careers

Data Scientist Team Lead

As a Data Scientist Quality Assurance Lead, you will review AI-generated data science work and contributor submissions for statistical soundness, code accuracy, reproducibility, and rubric fit. You will guide trainers and QAs, resolve technical questions, and maintain calibration and onboarding resources. This remote contract role has no immediate project; qualified experts may be contacted when relevant work becomes available.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $110/hr
  • data science
  • data science quality assurance
  • llm evaluation
Data Science & AnalyticsView job

micro1

Professional Shopper

Research products across categories, compare prices and competing options, and share grounded insights about consumer preferences. Your findings will help train AI systems, and you will review generated answers for accuracy against product information. Shopping and product expertise matter; prior AI experience is not required.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$20–$44/hr
  • Product Research
  • Price Comparison
  • Consumer Insights
Market Research & InsightsView job

Terac

General Consumers: Interview on User Experiences and Tasks

Take part in a paid, remote consumer study open to participants in India. During a session, you will answer questions, work through simple tasks, and respond to everyday scenarios. Researchers want your candid views, past experiences, and explanations of how you approach each prompt. People from varied personal and professional backgrounds can participate.

Location and eligibility
Remote · India only
Engagement type
Contract
Compensation
Pay not listed
  • consumer research
  • user experience
  • task evaluation
Market Research & InsightsView job

Ethos

Data Scientist

Help a foundational AI lab train a language model on data science documentation. You’ll review and assess documents, checking whether their content and structure match materials data scientists encounter in practice. The role suits experienced practitioners with current, hands-on knowledge of data science documents. Prior AI experience is not required. Work is remote, and weekly hours depend on client task volume; most experts work under 10 hours a week, with no weekly cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$100/hr
  • data science
  • machine learning
  • python
Data Science & AnalyticsView job

Turing

Domain Expert - Art

Create and evaluate prompts for AI in fine arts and design.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • art history
  • fine arts
  • visual arts
Machine Learning & AIView job

AfterQuery

Ocean, Atmosphere & Earth Observation Scientist

Use your experience in oceanography, atmospheric science, geoscience, or a related field to create research-level problems for AI models. The work draws on hands-on processing of raw field and instrument data, such as data from cruises, deployments, or field campaigns. You can take on tasks remotely with a flexible schedule and no fixed weekly hours.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • python
  • oceanography
  • atmospheric science
Science & ResearchView job

Meridial by Invisible

Cordobes (Argentina) Translation and Localization Expert

Independent contractors with native-level Cordobes fluency will record voice content and evaluate audio against written text. The work calls for a strong grasp of how Cordobes sounds in Argentina, including its pronunciation, accents, phrasing, tone, and cultural nuance. You will assess each sample for accuracy, clarity, naturalness, and alignment with detailed project guidelines.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$9/hr
  • cordobes
  • audio evaluation
  • voice recording
Language & LinguisticsView job

Reunion Marketing · via Braintrust

Sr. Full-Stack Engineer, AI-Native

Build and ship features across client-facing applications, platform services, and AI products for Reunion Marketing, including its Altitude Intelligence platform. You’ll own work from database design through the user interface, using AI coding assistants as a core development tool while maintaining production standards for security, testing, and reliability. The products serve hundreds of automotive dealerships across five marketing product lines.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$85–$90/hr
  • full-stack engineering
  • ai coding assistants
  • claude code
Machine Learning & AIView job

Mercor

Medical Affairs & Commercial Expert

Bring pharmaceutical or biotech expertise to AI training work across Medical Affairs, HEOR, market access, scientific communication, and commercial strategy. You will create and assess realistic medical and commercial tasks, then help improve model performance through detailed feedback and evaluation guidance. The role requires a 40-hour weekday commitment and offers W-2 employment with Cincinnatus LLC, with placement on a leading AI lab's team.

Location and eligibility
Remote · United States only
Engagement type
Full-time
Compensation
$70–$100/hr
  • medical affairs
  • health economics and outcomes research
  • market access
Health Informatics & Medical RecordsView job

Handshake AI

Pricing Analyst

Use your retail pricing experience on an ongoing, project-based AI research opportunity. You’ll create training scenarios, assess AI responses against real pricing and markdown practices, and write feedback to guide model improvement. The part-time work is remote and self-scheduled, with no set hours or minimum hour requirement, so you can take it on alongside your current work.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail pricing
  • price management
  • pricing strategy
Data Science & AnalyticsView job

SME Careers

Turkish Team Lead

Lead Turkish quality checks across AI training projects by reviewing generated content and contributor work against project rubrics. You will give actionable feedback, guide trainers and QAs through language questions, and keep Turkish style guides and quality records current. The role also covers onboarding and contributor follow-up, with team communication through tools such as Discord and Google Sheets.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $25/hr
  • turkish
  • english
  • llm evaluation
Language & LinguisticsView job

micro1

Rates trader

As a contract Rates Trader contributor, you’ll review AI-generated strategies for an investment bank’s algorithmic trading desk. You’ll compare model outputs with real rates-market practice, assess performance in simulated conditions, and share domain guidance with project leads and technologists. No AI background is needed; expertise in rates trading is the focus.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$80–$100/hr
  • interest rate swaps trading
  • swaptions trading
  • treasury futures trading
Business Analysis & StrategyView job

Terac

Desktop Professionals: AI Assistant Usage Study [ Mac Only ]

Take part in a paid study of a new desktop AI assistant. For at least four weeks, install the tool on your primary work computer and use it during your usual workday. It records your screen as you work, so you must be comfortable sharing your active work sessions and keeping a schedule of about 40 hours per week. You may also provide brief feedback at the end.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • ai assistant
  • knowledge work
  • screen recording
AI evaluationView job

Ethos

University Professor / Lecturer

Help a leading foundational AI lab train a language model on professional presentations and slide decks. You will create, assess, and refine materials for teaching, course design, conferences, concept explanations, assessments, and seminars. Work remotely on your own schedule, with an ASAP start. Task volume varies, hours are not guaranteed, and most experts work under 10 hours per week; no weekly hours cap applies.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$80/hr
  • powerpoint
  • slide design
  • presentation design
Education & TrainingView job

Turing

Strategic Project Lead – Software Engineering

Operate and manage software engineering data programs for AI models.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • project management
  • software engineering
  • python
Software EngineeringView job

AfterQuery

Process & Chemical Plant Engineer

Use your chemical engineering experience with real plant or pilot data to create research-level problems that test and train AI models. The work centers on data grounded in plant operations, including performance across columns, reactors, membranes and utilities, as well as guarantee testing. You can take on flexible, task-based contract work without a fixed weekly schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • chemical engineering
  • process engineering
  • python
EngineeringView job

Meridial by Invisible

Audio Evaluations: JSON & Coding Expert (Multiple Languages)

As an independent contractor, you will assess AI-generated technical and customer-facing responses for clarity, usefulness, natural language, and accuracy. The work centers on JSON structure and formatting, alongside coding knowledge and customer service judgment. Choose a language cohort that matches your fluency, then complete a language introduction and JSON assessment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$11/hr
  • json
  • coding
  • audio evaluation
Language & LinguisticsView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.