AIWorkJobs
Turing logoTuringPlatform listing

Senior Python Engineer – LLM Evaluation (US-based)

Create and refine Python solutions for training large language models.

Remote · United States onlyContract
Work arrangement
Remote
Eligibility
United States only
Engagement
Contract
Compensation
Pay not listed
Specialty
Machine Learning & AI

About the role

Create and assess code datasets that help train and benchmark large language models. You will focus on Python across backend services, data pipelines, and ML infrastructure, while also working with other programming languages. The work includes reviewing AI-generated code, building verification tools, and assessing model performance across stages of software development. Candidates must live in the United States.

What you would do

  • Curate code examples, develop solutions, and correct code for AI training projects, with a primary focus on Python and additional work in JavaScript, ReactJS, C/C++, Java, Rust, and Go.
  • Review AI-generated code and improve its efficiency, scalability, and reliability.
  • Work with cross-functional teams to assess AI coding solutions against industry performance benchmarks.
  • Build Python agents and automated verification tools that check code quality and detect error patterns.
  • Assess model capabilities across software engineering stages, from prototyping and architecture design through launch, monitoring, and maintenance.
  • Design verification methods that can automatically check solutions to software engineering tasks.

Requirements

  • At least 3 years of software engineering experience.
  • Strong Python expertise, including frameworks, tooling, and production software best practices.
  • Experience building full-stack applications and deploying scalable software with modern languages and tools.
  • Deep knowledge of software architecture, design, development, debugging, and code quality assessment.
  • Strong written and oral communication skills for explaining evaluation decisions in a clear, structured way.
  • Must be based in the United States.
  • Complete the required AI video interview as part of the application process.

Preferred qualifications

The source marks these as preferred, not required.

  • Production engineering experience at a high-scale company such as Google, Microsoft, Apple, Amazon, or Meta.
  • A degree from a leading computer science program such as Stanford, MIT, Carnegie Mellon, UC Berkeley, or Georgia Tech; equivalent experience and skill also count.

Who should apply

Engineers with at least 3 years of software development experience and deep Python skills will fit the work. Candidates must live in the United States and should be ready to evaluate AI-generated code, build verification tools, and explain their assessments.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • python
  • javascript
  • reactjs
  • c
  • c++
  • java
  • rust
  • go
  • software architecture
  • full-stack development
  • code review
  • code evaluation
  • ml infrastructure
  • data pipelines
  • automated verification

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: senior-python-engineer-llm-evaluation-us-based-73087. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

Senior Python Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • c++
  • c
Machine Learning & AIView job

Turing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

Turing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • react
Machine Learning & AIView job