AIWorkJobs
Turing logoTuringPlatform listing

Senior Software Engineer – Rust (LLM Evaluation & Repository Validation)

Analyze GitHub issues and evaluate LLM performance on software tasks.

Remote · Eligibility not specifiedContract
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Contract
Compensation
Pay not listed
Specialty
Other

About the role

Build and assess verifiable software engineering tasks drawn from public repository histories. You will work with Rust codebases, triage GitHub issues, prepare development environments, and judge test quality as researchers develop datasets for LLM training and evaluation. The contract runs for three months and offers 20, 30, or 40 hours per week, with at least four hours of daily overlap with PST.

What you would do

  • Review and triage issues in trending open-source libraries on GitHub.
  • Configure repositories and prepare development environments, including Docker setup.
  • Assess unit test coverage and test quality.
  • Run and modify codebases on a local machine to evaluate LLM performance on bug-fixing tasks.
  • Work with researchers to select repositories and issues that pose challenges for LLMs.
  • Help lead junior engineers on project work when needed.

Requirements

  • At least 3 years of overall experience as a software engineer.
  • Strong experience with Rust.
  • Proficiency with Git, Docker, and basic software pipeline setup.
  • Ability to navigate complex codebases.
  • Comfort running, modifying, and testing real-world projects on a local machine.
  • Availability for at least 20 hours per week and four hours per day, including four hours of overlap with PST.
  • Must be based in one of the listed eligible countries.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience contributing to or evaluating open-source projects.
  • Prior participation in LLM research or evaluation projects.
  • Experience building or testing developer tools or automation agents.

Who should apply

Software engineers with at least three years of experience and strong Rust skills will suit this work, especially candidates who can assess real GitHub repositories and test quality. Applicants must be available for at least 20 hours each week and maintain four hours of overlap with PST.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • rust
  • git
  • docker
  • github
  • unit testing
  • software pipelines
  • repository analysis
  • llm evaluation

Listing reference: senior-software-engineer-rust-llm-evaluation-repository-validation-37599. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

SME Careers

Rust Engineer

Review and write Rust code and explanations used to train AI models. You will judge generated solutions for correctness, safety, idiomatic style, and reasoning, with close attention to ownership, borrowing, lifetimes, and algorithms. The work requires strong technical writing in English and careful validation of AI-generated output. This is a remote contract role with no immediate project; qualified experts may be contacted when a suitable project becomes available.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $60/hr
  • rust
  • async rust
  • backend development
Safety reviewView job