AIWorkJobs
Turing logoTuringPlatform listing

Senior Software Engineer, AI Evaluation and Coding Agents

Evaluate and improve AI coding models by reviewing generated code.

Remote · Eligibility not specifiedFreelance
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Freelance
Compensation
$100–$150/hr
Specialty
AI Training

About the role

Review AI coding agents as they work across real repositories, judging whether their solutions meet the task and whether the code is correct, maintainable, and well reasoned. You’ll turn those assessments into evaluation criteria and feedback that help improve model performance. The freelance engagement runs for about three months and calls for 20–40 hours per week.

What you would do

  • Create and refine rubrics and criteria for preference data.
  • Review and label data, catching subtle quality issues.
  • Build and maintain pipelines and infrastructure for data generation, collection, and evaluation.
  • Summarize findings in clear updates, write-ups, and recommendations.
  • Work with researchers and engineers to turn qualitative judgments into scalable processes.

Requirements

  • At least 5 years of hands-on software engineering experience.
  • Strong skills in Python, TypeScript, JavaScript, Go, or another major production language.
  • Experience working in substantial real-world codebases.
  • Strong code-review skills and sound technical judgment.
  • Ability to explain why an implementation works, fails, or needs improvement.
  • Strong written communication skills.
  • Experience with modern LLMs or AI coding tools.
  • Availability for 20–40 hours per week, with at least 6 hours of Pacific Time overlap each day.
  • Must be located in North America.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience with LLM evaluation, coding agents, RLHF, preference data, rubric design, or post-training.

Who should apply

Software engineers with at least five years of hands-on experience and strong code-review judgment will suit this work. Candidates should be comfortable assessing AI-generated code in real repositories and explaining specific technical successes and failures.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • python
  • typescript
  • javascript
  • go
  • java
  • github
  • ci/cd
  • open source
  • llm
  • code review
  • code analysis
  • llm evaluation
  • coding agents
  • rlhf
  • preference data
  • rubric design

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: senior-software-engineer-ai-evaluation-and-coding-agents-104644. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

Senior Software Engineer – LLM Evaluation

Evaluate and refine AI-generated code for efficiency and reliability.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

Turing · via Braintrust

Senior Software Engineer - Python, TypeScript, JavaScript or Go

Help an AI research team build dependable evaluation workflows by pairing software engineering with preference-data review and rubric development. The remote contract runs for about three months, pays $100 per hour, and is open to candidates in the United States or Canada. The selection process starts with an information form and AI interview; selected candidates may then complete a coding challenge, with scores of 75% or higher advancing to team review and a possible live interview.

Location and eligibility
Remote · Canada, United States
Engagement type
Contract
Compensation
$100/hr
  • python
  • typescript
  • javascript
Software EngineeringView job

Turing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • react
Machine Learning & AIView job

Turing

Senior Python Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • c++
  • c
Machine Learning & AIView job