AIWorkJobs
Turing logoTuringPlatform listing

Senior Python Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Remote · United States onlyContract
Work arrangement
Remote
Eligibility
United States only
Engagement
Contract
Compensation
Pay not listed
Specialty
Machine Learning & AI

About the role

Create datasets that train and benchmark large language models, then assess how well models handle software engineering work. You will curate code, write and correct solutions, and review AI-generated code for systems-level correctness, performance, and reliability. The work also covers verification methods and collaboration with researchers and cross-functional teams. Candidates must be based in the United States and commit 10 to 40 hours per week.

What you would do

  • Curate code examples and write or correct solutions in Python, C/C++, Rust, Go, Java, and JavaScript, including ReactJS.
  • Evaluate and refine AI-generated code for systems-level correctness, performance, scalability, and reliability.
  • Work with researchers and cross-functional teams to improve AI coding solutions against industry performance benchmarks.
  • Build agents that check systems-level and infrastructure code and identify patterns in errors.
  • Assess model capabilities across software engineering stages, from prototyping and architecture design through launch, monitoring, and operational maintenance.
  • Design verification mechanisms that can confirm whether a software engineering solution meets its requirements.

Requirements

  • At least 3 years of software engineering experience.
  • Strong experience in systems programming, infrastructure, or backend development.
  • Expertise with languages such as Python, C/C++, Rust, or Go.
  • Experience building and deploying scalable, production-grade software with modern languages and tools.
  • A strong grasp of software architecture, design, development, debugging, and code quality review.
  • Clear oral and written communication skills for structured evaluation rationales.
  • Must be based in the United States.
  • Complete the required AI video interview as part of the application process.

Preferred qualifications

The source marks these as preferred, not required.

  • Engineering experience at frontier AI or technology organizations such as OpenAI, NVIDIA, Databricks, Palantir, or Snowflake.
  • Graduation from a leading program such as Harvard, Columbia, Princeton, Yale, or the University of Pennsylvania; relevant skill and experience take precedence over school background.

Who should apply

Candidates with at least 3 years of software engineering experience in systems programming, infrastructure, or backend development will fit the core work. Engineers based in the United States who can commit 10 to 40 hours each week and assess code with clear, structured reasoning should consider applying.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • python
  • c++
  • c
  • rust
  • go
  • java
  • javascript
  • reactjs
  • systems programming
  • infrastructure
  • backend development
  • software architecture
  • debugging
  • code review
  • large language models

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: senior-python-engineer-llm-evaluation-us-based-73091. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

Senior Python Engineer – LLM Evaluation (US-based)

Create and refine Python solutions for training large language models.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

Turing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

Turing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • react
Machine Learning & AIView job