AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

micro1

Military Writing Specialist

Use your military writing and reporting background to create and assess government-style material for AI training. You will work from prompts and supplied artifacts to produce reports, summaries, updates, model examples, and grading guidance. The project also calls for feedback on AI-generated reports and insight into Department of Defense documentation practices. No prior AI experience is needed, and contributors must be based in the US.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$40–$80/hr
  • military writing
  • federal documentation standards
  • report generation and evaluation
Technical Writing & DocumentationView job

Turing

Senior Software Engineer – LLM Evaluation

Evaluate and refine AI-generated code for efficiency and reliability.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

AfterQuery

Legal Experts

Use your legal expertise to help train and assess AI models that reason about the law. You may write challenging legal prompts, judge answers for accuracy and sound reasoning, catch fabricated citations or misapplied rules, draft model answers with explanations, and build rubrics for scoring response quality. The assessment requests Bar Admission credentials.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$125/hr
  • legal reasoning
  • legal research
  • citation verification
LegalView job

Boron · via Mercor

Multilingual Primary Care Physician, Clinical AI Evaluation

Apply your outpatient primary care experience to review clinical notes and assess AI-generated documentation for accuracy, completeness, and clinical soundness. You will annotate encounter data, flag gaps or errors, and give structured feedback that helps improve clinical documentation and decision-support tools. Applicants must practice in the US, hold an MD, and speak, listen, and write in English plus another listed language at C1 level or higher.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$170–$190/hr
  • primary care
  • family medicine
  • general internal medicine
Language & LinguisticsView job

Handshake AI

Merchandise Planner

Use your retail planning experience on flexible, project-based AI research. You’ll create training questions grounded in real merchandising workflows, assess AI-generated responses, and write feedback that helps improve model performance. The ongoing, part-time contract work has no set schedule or minimum hour requirement and can fit alongside your current work.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail merchandising
  • merchandise planning
  • inventory planning
AI evaluationView job

SME Careers

Telugu Expert with Mathematical Background

Use your mathematics education and Telugu expertise to shape AI language quality. You will write prompts and reference answers, assess AI-generated Telugu for meaning, grammar, tone, and cultural fit, and compare responses across topics such as education and customer support. The work also calls for clear English feedback, fact-checking, and close review of reasoning and policy risks.

Location and eligibility
Remote · India, United Arab Emirates, United States
Engagement type
Contract
Compensation
Up to $20/hr
  • telugu
  • english
  • mathematics
Language & LinguisticsView job

micro1

Member of Technical Staff, Model Training (applied research)

You will develop application-specific models across language, multimodal AI, robotics, and autonomous agents. The work spans the full development cycle: translating use cases into training data and objectives, adapting and evaluating models, then preparing them for deployment. You will connect applied machine learning research with production engineering, with an emphasis on task quality, inference speed, and computational cost.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$7–$8/hr
  • Model Training & Adaptation
  • Multimodal AI
  • Robotics & Agent Learning
Machine Learning & AIView job

Turing

AI Quality Analyst (Personalization) - German

Evaluate AI personalization by analyzing responses based on your experiences.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • german
  • ai evaluation
  • data annotation
Quality Assurance & TestingView job

AfterQuery

Human Resources Expert

Create and assess HR questions and case studies that help train AI models to handle real workplace scenarios. You will test model responses against HR practices and employment regulations, then work with HR and technical specialists to shape content that challenges models on recruitment, employee relations, compensation, and other core areas.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • human resources
  • recruitment
  • employee relations
Human ResourcesView job

Mercor

Legal Expert (J.D./LL.B.)

Join a standing pool of practicing lawyers for AI training and evaluation projects, rather than applying to one active opening. You may draft legal documents and grading references, assess model-written work, or explain why a legally accurate answer still fails in context. After you submit a resume, confirm your work location, and complete a roughly 20-minute AI interview, Mercor verifies your background and license before considering you for matching projects. Project invitations may come within a week or take several months.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100–$150/hr
  • legal drafting
  • litigation
  • transactional law
LegalView job

Handshake AI

Plant Performance Engineer

Use your energy industry experience to create expert training material and assess AI-generated answers about industrial operations, plant performance, and energy asset management. The project-based work is remote, self-scheduled, and has no minimum hour requirement. Contributors typically work 5–20 hours per week during active projects, with placement based on current needs and possible consideration for future projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • industrial operations
  • plant performance
  • energy asset management
Energy & Power GenerationView job

SME Careers

Philosophy Quality Assurance Lead (QAL)

As a remote contract lead, you will review philosophy-focused AI outputs and contributor work for logical validity, conceptual precision, sound interpretation, and rubric compliance. You will coach trainers and QAs, keep review guidance current, and address recurring quality gaps. The role calls for a relevant degree, at least three years of related experience, and clear written English.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $65/hr
  • philosophy
  • argument analysis
  • logic
Quality Assurance & TestingView job

micro1

Registered Nurse

A Registered Nurse will review inpatient records and judge whether AI-generated clinical responses are accurate, safe, and appropriate. The work covers documentation such as nursing and progress notes, care plans, orders, lab results, and discharge summaries. You will draw on bedside judgment and inpatient workflow knowledge to improve datasets and give feedback on project guidance. Prior AI experience is not required.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$60–$70/hr
  • inpatient clinical expertise
  • clinical documentation review
  • annotation of medical records
Healthcare & MedicalView job

AfterQuery

Machine Learning Research Expert

AfterQuery creates evaluation data that AI labs use to assess and improve their models. You’ll draw on your own research to develop and solve machine learning analysis problems covering experiment design, ablations, model evaluation, and behavior. The role suits hands-on researchers rather than engineers focused on deployment, data engineers, or annotators. Work remotely with an asynchronous schedule and no fixed hours.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$115/hr
  • machine learning
  • machine learning research
  • python
Machine Learning & AIView job

Mercor

Marketing Specialist Talent Network

Mercor’s Marketing Specialist network connects experienced marketing professionals with future contract projects at AI labs and companies. After you complete your profile and pass an AI interview, Mercor may match you with projects as they arise. Work can cover AI model training and evaluation, marketing deliverables, and expert feedback. Project scope and duration vary, with typical commitments of 15 to 30 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$80/hr
  • digital marketing
  • campaign management
  • market research
Digital & Performance MarketingView job

Handshake AI

Revenue, Demand & Supply Planning Professional

Use your retail or consumer-facing planning experience to create expert training material and assess AI-generated answers for accuracy and relevance. You’ll draw on hands-on knowledge of pricing, forecasting, inventory, and supply chain workflows. The work is remote, project-based, and asynchronous, with no minimum hours; contributors often work about 5–20 hours per week during active projects. No AI experience is required.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • demand forecasting
  • in-season reforecasting
  • inventory planning
Data Science & AnalyticsView job

SME Careers

Marathi Expert with Mathematical Background

Review AI-generated Marathi text and create reference answers that show accurate grammar, natural phrasing, and sound reasoning. You will compare model responses, check factual and cultural fit, and explain language issues in written English. The role requires a mathematics degree, advanced Marathi reading and writing, and at least three years of relevant professional experience; it follows an hourly remote contractor workflow.

Location and eligibility
Remote · India, Mauritius, Pakistan
Engagement type
Contract
Compensation
Up to $20/hr
  • marathi
  • english
  • mathematics
Language & LinguisticsView job

micro1

Food Delivery AI Response Evaluator

Review AI responses used in food delivery customer interactions and help improve how models handle real service scenarios. You’ll assess accuracy, relevance, and tone, flag problems, suggest changes, and write sample conversations. Food delivery knowledge matters more than prior AI experience, which is not required.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$10–$30/hr
  • food delivery domain knowledge
  • customer service
  • written communication
Machine Learning & AIView job

Turing

Python Machine Learning Engineer

Own end-to-end development of machine learning solutions for business needs.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • pandas
  • numpy
Machine Learning & AIView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.