AIWorkJobs
Turing logoTuringPlatform listing

Software Engineer – AI Research & Evaluation (US-based)

Create and evaluate datasets for training large language models in Python.

Remote · United States onlyContract
Work arrangement
Remote
Eligibility
United States only
Engagement
Contract
Compensation
Pay not listed
Specialty
AI Training

About the role

Create and assess datasets that help train and benchmark large language models. You’ll work with researchers on code examples and solutions, review AI-generated code, and build Python agents and verification tools. The work centers on Python, with projects also covering JavaScript, C/C++, Java, Rust, and Go. Candidates must be based in the United States; the contract calls for 10 to 40 hours per week and starts with a one-month term.

What you would do

  • Curate code examples, write solutions, and correct code for language model training and evaluation, with a primary focus on Python.
  • Review AI-generated code and improve it for efficiency, scalability, and reliability.
  • Work with cross-functional teams to strengthen AI coding solutions against industry performance benchmarks.
  • Build Python agents and automated verification tools that assess code quality and detect error patterns.
  • Assess model capabilities across software engineering stages, from prototyping and architecture through launch, monitoring, and maintenance.
  • Design mechanisms that automatically verify solutions to software engineering tasks.

Requirements

  • At least 3 years of software engineering experience.
  • Strong Python skills, including production-grade frameworks, tooling, and development practices.
  • Experience building full-stack applications and deploying scalable software with modern languages and tools.
  • Deep knowledge of software architecture, design, development, and debugging.
  • Ability to assess code quality and review code.
  • Strong written and spoken communication skills for clear, structured evaluation rationales.
  • Must be based in the United States.
  • Complete the required AI video interview as part of the application process.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience shipping high-impact products at high-growth engineering companies such as Stripe, Airbnb, Cloudflare, Datadog, or Coinbase.
  • Education from a leading program such as Harvard, Columbia, Princeton, Yale, or the University of Pennsylvania; equivalent experience and skill also matter.

Who should apply

Software engineers with at least 3 years of experience and strong production Python skills will suit the work, especially those who can assess architecture and code quality. Applicants must live in the United States and be available for 10 to 40 hours per week.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • python
  • javascript
  • reactjs
  • c++
  • java
  • rust
  • go
  • software architecture
  • full-stack development
  • code review
  • debugging
  • data pipelines
  • machine learning infrastructure
  • automated testing
  • code evaluation

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: software-engineer-ai-research-evaluation-us-based-73126. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

Software Engineer – AI Research & Evaluation (US-based)

Create and evaluate datasets to enhance AI-generated coding solutions.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • java
Machine Learning & AIView job

Turing

Software Engineer

Create and refine Python code for AI model training and evaluation.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$200/hr
  • python
  • javascript
  • react
Machine Learning & AIView job

Turing

Senior Software Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job