AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

micro1

Lawyer

As a U.S.-licensed lawyer, you will assess legal scenarios and examine AI-generated analyses, arguments, contracts, and other documents. Your legal judgment and written feedback will help improve AI systems’ legal reasoning, accuracy, and judgment. The work covers litigation, corporate transactions, and regulatory or compliance matters, and requires a J.D., an active U.S. bar license, and more than three years of post-J.D. practice.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$170/hr
  • legal reasoning
  • issue-spotting
  • legal writing
LegalView job

Ethos

Executive Communications Manager / Speechwriter

Help train a foundational AI lab’s language model by creating, evaluating, and refining AI-generated presentations and slide decks. Work covers keynote and conference decks, CEO narratives, speech-to-slide alignment, earnings call materials, and thought leadership presentations. The role is fully remote, with a flexible schedule. Task volume varies, hours are not guaranteed, and most experts work under 10 hours per week; no weekly hour cap applies. The start date is ASAP.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • executive communications
  • speechwriting
  • powerpoint
Content, Communications & PRView job

Turing

Software Engineer

Create and refine Python code for AI model training and evaluation.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$200/hr
  • python
  • javascript
  • react
Machine Learning & AIView job

AfterQuery

Office Manager Expert

Create and assess office management challenges used to train AI models. You will draw on experience in administrative leadership to develop scenarios about team supervision, operational workflows, and practical problem-solving, then check model answers against established office management standards. The role is remote and asynchronous, with a flexible schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$85/hr
  • office management
  • administrative leadership
  • team supervision
Machine Learning & AIView job

Meridial by Invisible

Multilingual AI Evaluator

Reviewers assess AI-generated content for accuracy, clarity, natural phrasing, and fit with project guidelines. You need C1-level fluency or higher in one of the requested languages and a strong grasp of its meaning, tone, phrasing, and cultural context. Projects come in batches, and availability depends on the language and project needs.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$9/hr
  • ai evaluation
  • french
  • arabic
Language & LinguisticsView job

Turing · via Braintrust

Japanese-English Physician - AI Clinical Evaluation

A Japan-based, licensed physician with active practice in Internal Medicine or Primary Care will evaluate clinical AI content for Type 2 diabetes care. The work covers Japanese patient histories, localization for Japanese clinical practice, and AI-generated management plans. The remote freelance project runs for 10 weeks, starts immediately, and requires about 15 hours per week. Each case takes about two hours.

Location and eligibility
Remote · Japan only
Engagement type
Contract
Compensation
$76/hr
  • data annotation
  • internal medicine
  • primary care
AI evaluationView job

General Translation · via Mercor

European Portuguese Linguistic Expert

Assess how well an LLM handles European Portuguese across translation, summarization, dialogue, and grammar correction. You will also refine and annotate language data, then share linguistic findings with AI researchers to support model improvements. The work calls for native or near-native European Portuguese and professional English fluency, with a strong grasp of usage in Portugal and how it differs from Brazilian Portuguese.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • european portuguese
  • portuguese grammar
  • portuguese syntax
Language & LinguisticsView job

Handshake AI

Aerospace Engineer

Use your aerospace background to build expert-level problems and scenarios, assess AI-generated answers, and write feedback that helps improve model performance. The work draws on real design, analysis, and flight-testing practice. You can complete project-based tasks on your own schedule, with no minimum hour requirement, alongside your current role.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$75/hr
  • aerospace engineering
  • aerodynamics
  • computational fluid dynamics
EngineeringView job

SME Careers

TypeScript Team Lead

Lead quality checks for TypeScript AI training work by reviewing code and contributor output against project rubrics. You’ll coach trainers and QA reviewers, resolve questions about type safety and runtime behavior, and maintain calibration and onboarding materials. This is a contract role with no immediate project assignment; qualified candidates may be contacted when relevant work opens. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $70/hr
  • typescript
  • javascript
  • node.js
Quality Assurance & TestingView job

micro1

Prompt & Response Evaluator

For about 7.5 hours between November 15 and November 18, you’ll test conversational AI assistants using your personal ChatGPT Free or Plus account. You’ll try everyday scenarios, compare the experiences, and submit ratings with brief written feedback. You’ll need a computer or smartphone and availability during the project window; the role is remote and open globally, with English required.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$40–$70/hr
  • ChatGPT
  • AI agents
  • Attention to Detail
AI evaluationView job

Ethos

Tax Professional

Help a leading foundational AI lab train its language model on professional tax presentations. You will create, assess, and refine slide decks covering tax structuring, technical positions, client advice, reform impacts, and tax provision communications. Work remotely on your own schedule; task volume varies, and most experts contribute fewer than 10 hours per week. The role can start ASAP.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$80/hr
  • tax
  • tax structuring
  • tax position analysis
Finance & AccountingView job

AfterQuery

Customer Service Representative Expert

Create customer support scenarios that test how AI models handle real-world interactions and service decisions. You will assess model answers against customer service standards and give detailed feedback, drawing on experience with support operations and best practices. The role is remote and asynchronous, with a flexible schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$55/hr
  • customer service
  • customer support operations
  • conflict resolution
Customer SupportView job

Meridial by Invisible

Audio Evaluations: JSON & Coding Expert (Portuguese, Brazil)

Review AI-generated coding and technical customer service content, including virtual agent replies, JSON, and audio-related material. You’ll check accuracy, clarity, natural language, and usefulness against project guidelines. The role requires native-level Brazilian Portuguese, but you do not need to live in Brazil. Selection includes a language introduction and a JSON assessment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$11/hr
  • brazilian portuguese
  • json
  • coding
Language & LinguisticsView job

Turing · via Braintrust

AI Evaluator – Education (Experienced Gemini Users)

Help assess and improve AI responses through research, fact-checking, logic analysis, and educational evaluation. The role suits students and working professionals who use the Gemini App for learning. Work remotely from the United States for an expected 16-week project, with a possible extension. Plan for at least 20 hours per week, up to 40 as project needs change, and four hours of overlap with Pacific working hours.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$20/hr
  • gemini app
  • research
  • fact-checking
AI evaluationView job

General Translation · via Mercor

Spanish (Venezuela) Linguistic Expert

Assess how well an LLM handles Venezuelan Spanish across translation, summaries, dialogue, and grammar correction. You will also refine and annotate Spanish data, then share language-specific findings with AI researchers to support model training. The role calls for near-native command of Venezuelan Spanish, professional English fluency, and experience with Spanish language work.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • spanish (venezuela)
  • english
  • translation
Language & LinguisticsView job

Handshake AI

Quantitative Analyst

Use your quant experience on an ongoing, project-based effort to improve AI research. You’ll create realistic quantitative challenges, assess model answers for accuracy and practical value, and write feedback that reflects how working quants approach research, modeling, and strategy. Set your own pace with no fixed schedule or minimum hours, alongside your current role.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$150/hr
  • quantitative analysis
  • quant research
  • alpha generation
Data Science & AnalyticsView job

SME Careers

JavaScript Team Lead

Guide quality across JavaScript AI training projects by reviewing code, debugging explanations, tests, and contributor work against project rubrics. You will coach trainers and QA reviewers, maintain project guidance, and flag correctness, security, and testing issues. This remote contract role has no immediate project; qualified candidates may be contacted when relevant work becomes available.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $70/hr
  • javascript
  • node.js
  • code review
Quality Assurance & TestingView job

micro1

Medical Doctor

Medical doctors across specialties can bring their clinical judgment to a remote, part-time contractor project supporting AI training. You will review medical content and AI responses, spot problems in clinical reasoning, and give evidence-based feedback. Applicants complete a short AI interview focused on medical knowledge and relevant experience.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
Pay not listed
  • medical knowledge
  • clinical reasoning
  • analytical skills
Healthcare & MedicalView job

Ethos

Special Education Specialist / IEP Consultant

Help train a language model for a foundational AI lab by creating, reviewing, and refining professional documents, spreadsheets, and slide decks for special education workflows. Work remotely on your own schedule, with a start date as soon as possible. Task volume varies, and most experts work under 10 hours per week; hours are not guaranteed, with no weekly cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$90/hr
  • special education
  • individualized education programs
  • iep writing
Education & TrainingView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.