AIWorkJobs
Turing logoTuringPlatform listing

Senior Software Engineer – Go (LLM Evaluation & Repository Validation)

Analyze GitHub issues and evaluate LLM performance on real-world code.

Remote · Eligibility not specifiedContract
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Contract
Compensation
Pay not listed
Specialty
Other

About the role

Help build LLM evaluation and training datasets from public repository histories. You’ll triage issues in open-source projects, prepare codebases for testing, assess test quality, and run bug-fixing scenarios to measure model performance. The work also calls for collaboration with researchers on challenging repositories and issues, with opportunities to lead junior engineers.

What you would do

  • Analyze and triage issues across trending open-source libraries.
  • Set up repositories, including Docker containers and development environments.
  • Review unit test coverage and assess test quality.
  • Run and modify codebases to evaluate LLM performance on bug-fixing tasks.
  • Work with researchers to select repositories and issues that challenge LLMs.
  • Lead junior engineers on project work when needed.

Requirements

  • At least 3 years of overall experience.
  • Strong experience with Go.
  • Proficiency with Git, Docker, and basic software pipeline setup.
  • Ability to navigate complex codebases.
  • Comfort running, modifying, and testing real-world projects on a local machine.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience contributing to or evaluating open-source projects.
  • Previous participation in LLM research or evaluation projects.
  • Experience building or testing developer tools or automation agents.

Who should apply

Experienced software engineers with at least 3 years in the field and strong Go skills will fit the role. Candidates should be comfortable preparing and testing complex open-source codebases, and available for the stated weekly commitment and PST overlap.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • go
  • git
  • docker
  • software pipelines
  • github
  • unit testing
  • test coverage
  • repository validation
  • llm evaluation
  • open-source software
  • development environment automation

Listing reference: senior-software-engineer-go-llm-evaluation-repository-validation-37601. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category