AIWorkJobs
Turing logoTuringPlatform listing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Remote · United States onlyContract
Work arrangement
Remote
Eligibility
United States only
Engagement
Contract
Compensation
Pay not listed
Specialty
Machine Learning & AI

About the role

Create and assess datasets that support large language model training and benchmarks. You’ll curate code examples, write solutions, correct code, and review AI-generated output, with a focus on Python and work across several other languages. You’ll also build verification tools and assess model performance across stages of the software engineering cycle. Candidates must live in the United States.

What you would do

  • Curate code examples, develop solutions, and correct code for AI model training, with a primary focus on Python and additional work in JavaScript, ReactJS, C/C++, Java, Rust, and Go.
  • Review and refine AI-generated code for efficiency, scalability, and reliability.
  • Work with cross-functional teams to improve AI coding systems against industry performance benchmarks.
  • Build Python agents and automated verification tools to check code quality and identify error patterns.
  • Assess model capabilities across software engineering stages, from prototyping and architecture design through launch, monitoring, and operational maintenance.
  • Design verification methods that can automatically check solutions to software engineering tasks.

Requirements

  • At least 3 years of software engineering experience.
  • Strong Python skills, including production-grade frameworks, tooling, and development practices.
  • Experience building full-stack applications and deploying scalable software with modern languages and tools.
  • Strong knowledge of software architecture, design, development, debugging, and code quality and review assessment.
  • Clear oral and written communication skills for structured evaluation rationales.
  • Must be based in the United States.
  • Complete the required AI video interview as part of the application process.
  • Commit to at least 10 hours per week, with capacity for up to 40 hours per week.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience building production systems at Google, Microsoft, Apple, Amazon, Meta, or a similar high-scale engineering organization.
  • A degree from Stanford, MIT, Carnegie Mellon, UC Berkeley, Georgia Tech, or a comparable computer science program.

Who should apply

Software engineers with at least 3 years of experience, strong production Python skills, and a background in full-stack development can contribute to code evaluation and model training. The role suits candidates based in the United States who can commit 10 to 40 hours each week.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • python
  • javascript
  • reactjs
  • c
  • c++
  • java
  • rust
  • go
  • large language models
  • code evaluation
  • dataset curation
  • software architecture
  • full-stack development
  • debugging
  • automated verification
  • machine learning infrastructure

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: senior-software-engineer-llm-evaluation-us-based-73019. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

Senior Python Engineer – LLM Evaluation (US-based)

Create and refine Python solutions for training large language models.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

Turing

Senior Python Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • c++
  • c
Machine Learning & AIView job

Turing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • react
Machine Learning & AIView job