AIWorkJobs
Turing logoTuringPlatform listing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Remote · United States onlyContract
Work arrangement
Remote
Eligibility
United States only
Engagement
Contract
Compensation
Pay not listed
Specialty
Machine Learning & AI

About the role

Create datasets that train and benchmark large language models, then assess and improve AI-generated code across backend and frontend systems. You’ll work with researchers and cross-functional teams on software engineering tasks, from architecture and API design to production operations. Applicants need at least 3 years of software engineering experience and must be based in the United States. The contractor engagement starts at 10 hours per week and can run up to 40.

What you would do

  • Curate code examples, write solutions, and correct code for AI model training, with work across Python, JavaScript, React, Node.js, C/C++, Java, Rust, and Go.
  • Review and refine AI-generated backend and frontend code for efficiency, scalability, and reliability.
  • Work with researchers and cross-functional teams to improve AI coding solutions against industry benchmarks.
  • Build agents that check code quality and detect error patterns in full-stack applications.
  • Propose software engineering workflow steps, from prototyping and architecture through launch, monitoring, and maintenance, then assess model performance on those tasks.
  • Design verification methods that can automatically check solutions to software engineering tasks.

Requirements

  • At least 3 years of software engineering experience.
  • Strong full-stack development skills with Python and JavaScript, including React and Node.js.
  • Experience shipping scalable, production-grade software with modern languages and tools.
  • Strong knowledge of software architecture, design, development, and debugging.
  • Ability to assess code quality and review code.
  • Clear written and spoken communication skills for structured evaluation rationales.
  • Must be based in the United States.
  • Available for at least 10 hours per week, with a maximum commitment of 40 hours per week.
  • Able to complete the required AI video interview as part of an application process that takes 15 to 30 minutes.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience shipping high-impact products at a high-growth engineering company such as Stripe, Airbnb, Cloudflare, Datadog, or Coinbase.
  • A computer science background from a program such as the University of Washington, University of Illinois Urbana-Champaign, UT Austin, University of Michigan, Purdue, or a comparable institution.

Who should apply

Software engineers with 3 or more years of experience building production-grade full-stack systems can contribute code examples, evaluate model output, and design verification methods. Candidates must live in the United States and have capacity for 10 to 40 hours of work per week.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • python
  • javascript
  • react
  • node.js
  • c
  • c++
  • java
  • rust
  • go
  • full-stack development
  • software architecture
  • api design
  • debugging
  • code review
  • large language models
  • dataset curation

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: senior-software-engineer-llm-evaluation-us-based-73086. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

Turing

Senior Python Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • c++
  • c
Machine Learning & AIView job

Turing

Senior Python Engineer – LLM Evaluation (US-based)

Create and refine Python solutions for training large language models.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job