AIWorkJobs
Turing logoTuringPlatform listing

Senior Software Engineer – C#(LLM Evaluation & Repository Validation)

Analyze GitHub issues and improve code quality for LLM evaluation.

Remote · Eligibility not specifiedContract
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Contract
Compensation
Pay not listed
Specialty
Software Engineering

About the role

Help build datasets that test how well large language models handle realistic software engineering work. You’ll inspect issues in established open-source repositories, prepare codebases for testing, and assess model performance on bug fixes. The work combines hands-on C# engineering, repository validation, and collaboration with researchers in a remote contractor role.

What you would do

  • Review and triage issues across active open-source libraries.
  • Configure repositories and prepare development environments, including Docker setups.
  • Assess unit test coverage and test quality.
  • Run and modify codebases to evaluate LLM performance on bug-fixing tasks.
  • Work with researchers to select repositories and issues that challenge LLMs.
  • Take the lead on projects with junior engineers when needed.

Requirements

  • At least 3 years of overall experience in software engineering.
  • Strong experience with C#.
  • Proficiency with Git and Docker.
  • Familiarity with basic software pipeline setup.
  • Ability to navigate complex codebases.
  • Comfort running, modifying, and testing real-world projects on a local machine.
  • Availability for at least 20 hours per week, with at least 4 hours of overlap with PST each day.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience contributing to or evaluating open-source projects.
  • Previous involvement in LLM research or evaluation.
  • Experience building or testing developer tools or automation agents.

Who should apply

Software engineers with at least 3 years of experience and strong C# skills will fit the core work. Candidates should be comfortable working in complex repositories and meeting the required weekly hours and PST overlap.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • c#
  • git
  • docker
  • software engineering
  • unit testing
  • test coverage
  • issue triage
  • repository validation
  • software pipelines
  • llm evaluation

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: senior-software-engineer-cllm-evaluation-repository-validation-37602. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category