AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

SME Careers

Python Engineer

Review AI-generated Python code and technical explanations for correctness, design quality, performance, and fit to the prompt. You will also write reference solutions and clear technical explanations, then compare candidate responses by their reasoning and implementation. The role calls for substantial production experience with Python, strong software engineering fundamentals, and C1 proficiency in both English and Chinese.

Location and eligibility
Remote · Eligible in 21 countries
Engagement type
Contract
Compensation
Up to $60/hr
  • python
  • algorithms
  • data structures
Machine Learning & AIView job

Turing · via Braintrust

Senior Software Engineer - Python, TypeScript, JavaScript or Go

Help an AI research team build dependable evaluation workflows by pairing software engineering with preference-data review and rubric development. The remote contract runs for about three months, pays $100 per hour, and is open to candidates in the United States or Canada. The selection process starts with an information form and AI interview; selected candidates may then complete a coding challenge, with scores of 75% or higher advancing to team review and a possible live interview.

Location and eligibility
Remote · Canada, United States
Engagement type
Contract
Compensation
$100/hr
  • python
  • typescript
  • javascript
Software EngineeringView job

Turing

Software Engineer – AI Research & Evaluation (US-based)

Create and evaluate datasets to enhance AI-generated coding solutions.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • java
Machine Learning & AIView job

Handshake AI

Aerospace Engineer

Use your aerospace background to build expert-level problems and scenarios, assess AI-generated answers, and write feedback that helps improve model performance. The work draws on real design, analysis, and flight-testing practice. You can complete project-based tasks on your own schedule, with no minimum hour requirement, alongside your current role.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$75/hr
  • aerospace engineering
  • aerodynamics
  • computational fluid dynamics
EngineeringView job

Mercor

SWE-Bench Task Auditor

Review repository-level software engineering benchmarks used to train and evaluate a frontier AI lab’s models. You’ll examine task quality, reference patches, test harnesses, Docker isolation, and grading integrity, then write clear feedback against a rubric. The role calls for professional software engineering experience and open-source contribution or maintainer work. The listing is limited to the United States.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$90/hr
  • python
  • java
  • go
Quality Assurance & TestingView job

micro1

Senior Forward Deployed Engineer, U.S. Government

Lead applied AI engineering from research through production for high-assurance, mission-critical U.S. Government work. You’ll shape architecture, build agentic systems, and turn mission needs into reliable deployments with government partners. The role is based in the Greater Washington, DC area and requires onsite work 3-4 days each week.

Location and eligibility
Hybrid · United States only
Engagement type
Full-time
Compensation
$40–$60/hr
  • Agentic AI & LLM Systems Engineering
  • Python & Production Software Engineering
  • ML Infrastructure & Model Evaluation
Machine Learning & AIView job

SME Careers

Kotlin Engineer

Review and compare AI-generated Kotlin solutions for correctness, sound reasoning, and fit with each prompt. You will also write model answers and explanations, check technical claims, and flag errors in code or architecture. This remote contract role has no immediate project; qualified engineers may be contacted when relevant work opens through the expert network.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $55/hr
  • kotlin
  • android development
  • android jetpack
Machine Learning & AIView job

Turing

Senior Python Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • c++
  • c
Machine Learning & AIView job

Handshake AI

Engineering Professional

Contribute engineering expertise to an AI research project focused on how models interpret professional tasks and language. Project work may include writing industry-specific prompts and reviewing LLM responses. The program runs year-round, but project placement depends on availability. Work remotely on a flexible schedule, with no minimum hour commitment.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • mechanical engineering technology
  • electrical engineering
  • bioengineering
Machine Learning & AIView job

Mercor

AI Developer Trace Task Auditor

Review coding sessions created with AI developer tools for a frontier AI lab’s model training and evaluation work. You’ll judge whether each trace reaches a correct result, follows a sound development process, and shows sound reasoning. Your written feedback should explain your assessment and follow the provided rubric.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$90/hr
  • software development
  • ai-assisted coding
  • cursor
Quality Assurance & TestingView job

Handshake AI

Software Engineer

Help assess and improve coding agents by giving them real engineering tickets, running their work, and tracing mistakes through a codebase you know. The contract offers 40 hours each week at $6,000, paid each week, with hours you set. It renews each week when your work meets quality standards. Selection involves a proctored coding assessment and a paid trial task.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$150/hr
  • software engineering
  • code review
  • coding agents
Software EngineeringView job

Turing

Senior Python Engineer – LLM Evaluation (US-based)

Create and refine Python solutions for training large language models.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

Handshake AI

Drilling Engineer

Use your drilling and energy operations experience to create expert training data and assess AI-generated answers for accuracy and relevance. The work draws on knowledge of drilling workflows, well planning, and energy data tools. It is remote and project-based, with a flexible schedule and no minimum hours. Contributors often work 5–20 hours per week during active projects; future placements depend on project needs. No AI experience is required.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • drilling operations
  • drilling engineering
  • completions
Data EngineeringView job

Turing

Software Engineer

Create and refine Python code for AI model training and evaluation.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$200/hr
  • python
  • javascript
  • react
Machine Learning & AIView job

Handshake AI

Security Engineer

Use your security engineering or offensive security experience to build expert training data and assess AI-generated security content. This remote, part-time contract work is project-based, with a flexible asynchronous schedule and no minimum hours. Contributors often work about 5–20 hours per week during active projects. Placement depends on project needs, with consideration for future projects as they open.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $80/hr
  • security engineering
  • offensive security
  • penetration testing
CybersecurityView job

Turing

SWE Bench – Data Engineer/Data Scientist

Build and validate data pipelines for AI performance evaluation projects.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • data engineering
  • data science
Data EngineeringView job

Showing 20 active roles of 30. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.