AIWorkJobs
Turing logoTuringPlatform listing

Senior Software Engineer – LLM Evaluation

Evaluate and refine AI-generated code for efficiency and reliability.

Remote · Eligibility not specifiedContract
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Contract
Compensation
Pay not listed
Specialty
Machine Learning & AI

About the role

Create datasets that help train and benchmark large language models, then assess the code they produce. You will write and correct code across several languages, review AI-generated solutions for efficiency, scalability, and reliability, and work with researchers and cross-functional teams. The engagement requires at least 10 hours per week and some overlap with PST.

What you would do

  • Curate code examples and write or correct solutions in Python, JavaScript, ReactJS, C/C++, Java, Rust, and Go.
  • Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
  • Work with cross-functional teams to improve AI coding solutions against industry performance benchmarks.
  • Build agents that check code quality and detect error patterns.
  • Assess model capabilities across software engineering stages, from prototyping and architecture design to launch, monitoring, and operations.
  • Design verification methods that can automatically check solutions to software engineering tasks.

Requirements

  • Several years of software engineering experience.
  • At least 2 years of continuous, full-time experience at a top-tier product company, such as Google, Stripe, Amazon, Apple, Meta, Netflix, Microsoft, Datadog, Dropbox, Shopify, PayPal, or IBM Research.
  • Strong experience building full-stack applications and deploying scalable, production-grade software with modern languages and tools.
  • Deep knowledge of software architecture, design, development, debugging, and code quality and review assessment.
  • Strong oral and written communication skills for clear, structured evaluation rationales.

Who should apply

Software engineers with several years of experience, including 2+ continuous full-time years at a top-tier product company, will fit the stated background. The work suits candidates with full-stack and production software expertise who can assess code and explain their reasoning.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • python
  • javascript
  • reactjs
  • c
  • c++
  • java
  • rust
  • go
  • full-stack development
  • software architecture
  • debugging
  • code review
  • large language models
  • ai code evaluation

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: senior-software-engineer-llm-evaluation-35501. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • react
Machine Learning & AIView job

Turing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

Turing

Senior Python Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • c++
  • c
Machine Learning & AIView job