AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Turing · via Braintrust

Staff Research Engineer - Frontier AI and Reinforcement Learning - International

Advance frontier AI research across synthetic and agentic data, reinforcement learning, post-training, model understanding, benchmarks, and evaluation. Build research-grade prototypes and help translate validated findings into scalable systems. The project runs for three months and starts immediately. It requires at least 40 hours per week, eight hours per day, with four hours of daily Pacific Time overlap. Selection includes a 20-minute client AI interview and a 45-60-minute technical delivery interview. Include your LinkedIn profile URL with your resume.

Location and eligibility
Remote · Eligible in 9 countries
Engagement type
Contract
Compensation
$26/hr
  • python
  • machine learning
  • reinforcement learning
Machine Learning & AIView job

Handshake AI

Quantitative Finance Researcher

Use your background in quantitative finance to create expert training material and assess AI-generated responses for accuracy and relevance. You’ll contribute feedback that helps AI systems handle quantitative finance research and methods. The work is remote, project-based, and hourly, with a flexible schedule and no minimum hours. Contributors typically work about 5–20 hours a week during active projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$75–$150/hr
  • quantitative finance
  • mathematical finance
  • financial engineering
Finance & AccountingView job

SME Careers

Customer Service (Call Center) Expert

Use your call center expertise to shape natural conversations for speech-to-speech AI agents. You will act out customer support scenarios, assess and rank model responses, and check outputs for inaccuracies or bias. The role requires at least two years in customer service, one year in AI training, and C1+ spoken English; the English requirement is limited to US candidates.

Location and eligibility
Remote · Canada, United States
Engagement type
Contract
Compensation
Up to $30/hr
  • ai training
  • call center
  • customer service
Customer SupportView job

micro1

Equity & Credit Research Expert

Use your financial research expertise to assess company statements, market data, and investment scenarios for an AI training project. You will develop equity and credit commentary, review research materials, and provide examples and feedback that help shape useful training data. Prior AI experience is not required; the role calls for strong knowledge of financial markets and analysis.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$90–$120/hr
  • financial analysis
  • equity research
  • credit research
Market Research & InsightsView job

Ethos

Marketing Manager (B2B)

Work with a leading foundational AI lab to train its latest language model on professional presentations. You will create, assess, and refine AI-generated decks across marketing and leadership workflows, including campaign reviews, product launches, budgets, events, and positioning. The role is fully remote with a flexible schedule; hours depend on client task volume, are not guaranteed, and most experts work under 10 hours per week. The start date is ASAP, with no weekly cap on hours.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • b2b marketing
  • powerpoint
  • slide design
Marketing & Brand ManagementView job

AfterQuery

Customer Service Representative Expert

Create customer support scenarios that test how AI models handle real-world interactions and service decisions. You will assess model answers against customer service standards and give detailed feedback, drawing on experience with support operations and best practices. The role is remote and asynchronous, with a flexible schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$55/hr
  • customer service
  • customer support operations
  • conflict resolution
Customer SupportView job

Turing

Software Engineer

Create and refine Python code for AI model training and evaluation.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$200/hr
  • python
  • javascript
  • react
Machine Learning & AIView job

General Translation · via Mercor

Latin American Spanish Linguistic Expert

Assess how well a large language model handles Spanish-language tasks, then refine and annotate Spanish data to support its training. You will review areas such as translation, summarization, dialogue, and grammar correction, applying native or near-native Latin American Spanish expertise and an understanding of regional usage.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • latin american spanish
  • spanish grammar
  • spanish syntax
Language & LinguisticsView job

Outlier · via Braintrust

Senior Systems & Hardware Experts - AI Benchmarking

Use your systems or hardware engineering experience to create difficult, clearly specified challenges for AI agents to solve in a Linux terminal. The project is task-based and expected to last a few weeks. Tasks average six to seven hours, with early submissions potentially taking longer. Earn up to $1,350 per task, with higher rates possible based on task quality and submission volume. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar.

Location and eligibility
Remote · Eligible in 25 countries
Engagement type
Contract
Compensation
$1,350 fixed
  • systems engineering
  • hardware engineering
  • linux
Hardware & Embedded SystemsView job

Handshake AI

Financial Services Professionals

Financial services professionals with at least four years of experience can contribute to a year-round AI research program. Project work may include writing industry-specific prompts and reviewing large language model responses to help improve AI understanding of professional tasks and language. Work is remote, asynchronous, and flexible, with no minimum hours. Project placement depends on availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • financial services
  • credit authorization
  • financial risk
Finance & AccountingView job

SME Careers

R Team Lead

Lead quality checks for R programming and data-analysis work used in AI training projects. You will assess generated code, statistical explanations, charts, and trainer reviews against project rubrics, then give specific feedback and maintain guidance for contributors. The role is a remote contract with no immediate project; qualified experts may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $65/hr
  • r
  • tidyverse
  • base r
Quality Assurance & TestingView job

micro1

Lawyer

As a U.S.-licensed lawyer, you will assess legal scenarios and examine AI-generated analyses, arguments, contracts, and other documents. Your legal judgment and written feedback will help improve AI systems’ legal reasoning, accuracy, and judgment. The work covers litigation, corporate transactions, and regulatory or compliance matters, and requires a J.D., an active U.S. bar license, and more than three years of post-J.D. practice.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$170/hr
  • legal reasoning
  • issue-spotting
  • legal writing
LegalView job

Ethos

Revenue/GTM Operations Specialist

Use your revenue and CRM operations expertise to help train a language model from a foundational AI lab. You will create, assess, and refine professional documents, spreadsheets, and slide decks for core GTM workflows, including field mapping, lead routing, territory models, pipeline audits, funnel dashboards, and data deduplication.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100/hr
  • revenue operations
  • gtm operations
  • crm operations
Sales & Business DevelopmentView job

AfterQuery

Research Scientist — Formal Methods / Computational Science

Join a research cohort of senior experts across mathematics, physics, chemistry, and biology. You’ll set standards for correct, high-quality reasoning on demanding real-world problems, then use those standards to assess frontier AI models. The work centers on research and evaluation, not production engineering. Applicants need a PhD or doctorate and at least 10 years of experience.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • formal methods
  • computational science
  • mathematics
Science & ResearchView job

General Translation · via Mercor

Chinese (Taiwan) Linguistic Expert

Assess a large language model (LLM) on Taiwanese Mandarin in Traditional Chinese, then help shape the language data used to improve its output. You will review text for accuracy and naturalness, apply Taiwan-specific linguistic and cultural standards, and share detailed findings with AI researchers. The work calls for strong command of Taiwanese Mandarin and professional English fluency.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • taiwanese mandarin
  • traditional chinese
  • translation
Language & LinguisticsView job

Outlier · via Braintrust

Senior Coding, ML & Security Experts - AI Benchmarking

Create difficult benchmark tasks from your professional experience in coding, machine learning, or cybersecurity. Each task must run in a Linux terminal and challenge advanced AI agents: three leading models get three attempts each, and they should fail most attempts. The project should run for the next few weeks. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar before tasking. Pay reaches $1,350 per task, with higher rates possible based on task quality and submission volume; tasks average six to seven hours, and your first tasks may take longer.

Location and eligibility
Remote · Eligible in 25 countries
Engagement type
Contract
Compensation
$1,350 fixed
  • coding
  • machine learning
  • cybersecurity
Machine Learning & AIView job

Handshake AI

Reliability Engineer

Use your energy industry experience to create expert training material and assess AI-generated responses about industrial operations, plant performance, and energy asset management. The work runs on a project basis, with remote, asynchronous scheduling and no minimum hour requirement. Contributors often work 5–20 hours a week during active projects, and teams may consider them for future projects as needs arise.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • industrial operations
  • plant performance
  • energy asset management
Cloud & DevOpsView job

SME Careers

Ubuntu/Linux User for AI Data Training

Use a personal Ubuntu/Linux computer to complete structured tasks that support AI training data quality. You will install project software, follow written procedures, review your work, and flag unclear instructions or technical problems. The work calls for about 15 hours per week; prior AI experience is not required.

Location and eligibility
Remote · Eligible in 61 countries
Engagement type
Contract
Compensation
Up to $20/hr
  • ubuntu
  • linux
  • software installation
Machine Learning & AIView job

micro1

Medical Doctor

Medical doctors across specialties can bring their clinical judgment to a remote, part-time contractor project supporting AI training. You will review medical content and AI responses, spot problems in clinical reasoning, and give evidence-based feedback. Applicants complete a short AI interview focused on medical knowledge and relevant experience.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
Pay not listed
  • medical knowledge
  • clinical reasoning
  • analytical skills
Healthcare & MedicalView job

Showing 20 active roles of 323. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.