AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Turing

Senior Software Engineer – LLM Evaluation

Evaluate and refine AI-generated code for efficiency and reliability.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

Mercor

Physician Talent Network

Join Mercor’s physician network for potential contract projects with AI labs and companies. After you complete a profile and pass an AI interview, Mercor may match you with projects as they become available. Work can include medical model training and evaluation, with commitments that typically range from 15 to 30 hours per week. Project scope and duration vary.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$110–$250/hr
  • clinical diagnosis
  • medical treatment
  • patient care management
Machine Learning & AIView job

Handshake AI

Senior Software Engineer - AI Data (MX)

Review coding agents as they tackle real engineering tickets, then work through problems in codebases you know to pinpoint and correct model mistakes. The contract offers 40 hours of work each week, with flexible scheduling and weekly renewal when your work meets quality standards. The selection process includes a proctored coding assessment and a paid trial task.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60/hr
  • software engineering
  • code review
  • coding agents
Machine Learning & AIView job

micro1

Member of Technical Staff, Model Training (applied research)

You will develop application-specific models across language, multimodal AI, robotics, and autonomous agents. The work spans the full development cycle: translating use cases into training data and objectives, adapting and evaluating models, then preparing them for deployment. You will connect applied machine learning research with production engineering, with an emphasis on task quality, inference speed, and computational cost.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$7–$8/hr
  • Model Training & Adaptation
  • Multimodal AI
  • Robotics & Agent Learning
Machine Learning & AIView job

AfterQuery

Human Resources Expert

Create and assess HR questions and case studies that help train AI models to handle real workplace scenarios. You will test model responses against HR practices and employment regulations, then work with HR and technical specialists to shape content that challenges models on recruitment, employee relations, compensation, and other core areas.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • human resources
  • recruitment
  • employee relations
Human ResourcesView job

Turing

Python Machine Learning Engineer

Own end-to-end development of machine learning solutions for business needs.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • pandas
  • numpy
Machine Learning & AIView job

Mercor

Management Consultant Talent Network

Mercor’s Management Consultant Expert Network connects experienced consultants with AI labs and companies seeking domain expertise. After you complete your profile and pass an AI interview, Mercor may match you with future projects as needs arise. Work can include AI model training and evaluation, scenario-based task creation, and feedback for AI research. Projects typically call for 15–30 hours per week, though scope and duration vary.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$100/hr
  • management consulting
  • strategic analysis
  • problem solving
Machine Learning & AIView job

Handshake AI

Senior Software Engineer - AI Data (IN)

Use your software engineering experience to assess coding agents on real engineering problems. You’ll give an agent a ticket and review its work, then work through a problem in a codebase you know and mark where the model fails. The contract offers 40 hours of work each week, with flexible scheduling and weekly renewal based on quality standards.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60/hr
  • software engineering
  • code review
  • pull requests
Machine Learning & AIView job

micro1

Food Delivery AI Response Evaluator

Review AI responses used in food delivery customer interactions and help improve how models handle real service scenarios. You’ll assess accuracy, relevance, and tone, flag problems, suggest changes, and write sample conversations. Food delivery knowledge matters more than prior AI experience, which is not required.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$10–$30/hr
  • food delivery domain knowledge
  • customer service
  • written communication
Machine Learning & AIView job

AfterQuery

Machine Learning Research Expert

AfterQuery creates evaluation data that AI labs use to assess and improve their models. You’ll draw on your own research to develop and solve machine learning analysis problems covering experiment design, ablations, model evaluation, and behavior. The role suits hands-on researchers rather than engineers focused on deployment, data engineers, or annotators. Work remotely with an asynchronous schedule and no fixed hours.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$115/hr
  • machine learning
  • machine learning research
  • python
Machine Learning & AIView job

Turing

Senior Python Developer

Develop and maintain high-quality Python code for AI model training and evaluation.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • unit testing
  • integration testing
Machine Learning & AIView job

Mercor

Legal Expert (J.D./LL.B.)

Join a standing pool of practicing lawyers for AI training and evaluation projects, rather than applying to one active opening. You may draft legal documents and grading references, assess model-written work, or explain why a legally accurate answer still fails in context. After you submit a resume, confirm your work location, and complete a roughly 20-minute AI interview, Mercor verifies your background and license before considering you for matching projects. Project invitations may come within a week or take several months.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100–$150/hr
  • legal drafting
  • litigation
  • transactional law
LegalView job

Handshake AI

Senior Software Engineer - AI Data (CA)

Review coding agents on real engineering tickets, run their code, and assess the results as you would a teammate’s pull request. You’ll also work through a problem in a codebase you know, noting where the model falters. The contract provides 40 hours of work each week, with flexible scheduling, and requires at least four years of professional software engineering experience.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$120/hr
  • software engineering
  • code review
  • coding agents
Software EngineeringView job

micro1

Army Combat Operations Expert

Bring firsthand Army combat operations experience to an AI development project focused on military tactics, battlefield scenarios, and operational decisions. You’ll assess AI-generated content for realism and accuracy, flag errors, and write structured feedback on its reasoning and alignment with Rules of Engagement and the Law of Armed Conflict. The work supports micro1’s MissionReport benchmark for evaluating AI-generated military and government reports.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$90–$170/hr
  • army tactics
  • tactical operations
  • mission planning
Machine Learning & AIView job

AfterQuery

Project Iter

AfterQuery is seeking doctoral researchers and industry professionals to contribute expertise to research projects across academic disciplines. Over the next 2–3 weeks, you can accept asynchronous projects requiring an expected 10–20 hours per week. Work may include literature synthesis, technical writing, data analysis, experiment design, and specialized research that supports AI evaluation and benchmarking.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$150/hr
  • literature review
  • technical writing
  • data analysis
Machine Learning & AIView job

Turing

Investment Banking Analyst

Evaluate and improve AI models using investment banking expertise.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
$100/hr
  • investment banking
  • mergers and acquisitions
  • financial modeling
Machine Learning & AIView job

Mercor

Marketing Specialist Talent Network

Mercor’s Marketing Specialist network connects experienced marketing professionals with future contract projects at AI labs and companies. After you complete your profile and pass an AI interview, Mercor may match you with projects as they arise. Work can cover AI model training and evaluation, marketing deliverables, and expert feedback. Project scope and duration vary, with typical commitments of 15 to 30 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$80/hr
  • digital marketing
  • campaign management
  • market research
Digital & Performance MarketingView job

Handshake AI

Data Scientist

Use your data science experience on flexible, project-based AI research work. You’ll create realistic problems grounded in modeling and experimentation, assess AI responses for technical accuracy and practical relevance, then write feedback that helps improve model performance. The work has no fixed schedule or minimum hour requirement and can fit alongside your current role. Applicants must live in the United States.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$120/hr
  • data science
  • machine learning
  • applied machine learning
Data Science & AnalyticsView job

micro1

Military Operations Expert

Current and former military professionals will assess AI-generated scenarios for an AI development project centered on military operations, tactical decisions, and international humanitarian law. You will check operational realism and accuracy, review how scenarios handle constraints, and give structured feedback that helps improve model reasoning and reliability.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$90–$170/hr
  • military operations expertise
  • tactical decision-making
  • operational planning
Machine Learning & AIView job

AfterQuery

Scientific Computing Research Expert

Create research-grade AI evaluation tasks from computational work you have performed in your field. AfterQuery commissions tasks across life, physical, Earth, mathematical, and engineering sciences. You will define how evaluators should assess a strong solution, revise your task after expert feedback, and may also review work from other domain experts. The work follows a flexible, task-based schedule with no fixed weekly hours.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • python
  • scientific computing
  • data analysis
Science & ResearchView job

Showing 20 active roles of 323. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.