AIWorkJobs
AfterQuery logoAfterQueryPlatform listing

Advanced Coding Expert

Create realistic, investigation-heavy coding challenges from a substantial private codebase you own. Your tasks will help evaluate and train advanced AI coding agents, so you’ll need to trace changes across large…

Remote · Eligibility not specifiedNot specified
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Not specified
Compensation
$85/hr
Specialty
AI Training

About the role

Create realistic, investigation-heavy coding challenges from a substantial private codebase you own. Your tasks will help evaluate and train advanced AI coding agents, so you’ll need to trace changes across large, multi-file projects and build containerized environments with tests that reflect careful engineering review.

What you would do

  • Develop long-horizon coding tasks based on real bugs, features, regressions, or migrations in substantial codebases.
  • Write prompts that require coding agents to investigate the code and carry out complex changes.
  • Create deterministic test suites and review criteria that verify solutions, catch regressions, and guard against shortcut solutions.
  • Use Docker or similar tools to package tasks in environments that build and run consistently.

Requirements

  • Proficiency in at least one modern programming language, such as JavaScript or TypeScript, Java, Go, Rust, C or C++, or Python.
  • Experience architecting or maintaining substantial, complex software projects.
  • Hands-on experience with Docker or a comparable containerization tool.
  • Strong technical writing, documentation, and testing skills.
  • Access to a substantial, complex private codebase that you own and can use to create tasks.
  • Experience using coding agents on long tasks.

Preferred qualifications

The source marks these as preferred, not required.

  • Background in code review, test authoring, or maintaining production or open-source systems.
  • Exposure to AI evaluation, rubric or data grading, or prompt writing.

Who should apply

Experienced software engineers with a substantial private codebase can turn realistic engineering problems into challenging agent tasks. Strong candidates can trace changes across a large project and build tests that assess solutions with care.

How applying works on AfterQuery

Create an account, complete an interview and a domain assessment, then get matched to a project.

  1. Create an account and submit the short application.
  2. Complete a live or asynchronous video interview.
  3. Pass a short domain skills assessment.
  4. Get matched to a project and begin work.

Paid steps: Not stated by the source

Assessment requirements and payment setup can vary by project.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full AfterQuery process and its official source on the AfterQuery page.

Skills mentioned by the source

  • javascript
  • typescript
  • java
  • go
  • rust
  • c
  • c++
  • python
  • docker
  • software architecture
  • software testing
  • technical documentation
  • code review
  • ai evaluation

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: advanced-coding-expert-142747. Source: AfterQuery. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Google DeepMind · via Braintrust

Code Quality Specialist / Research Engineer

Review AI coding attempts and determine whether failures stem from the code, benchmark tests, task instructions, or execution environment. You’ll examine Python and other code, test behavior, and run logs, then document evidence-based conclusions. The contract requires 35 hours per week and is open to candidates in the United States. Work starts immediately.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$75–$105/hr
  • python
  • git
  • docker
Quality Assurance & TestingView job

micro1

Member of Technical Staff, Coding Agent Research & Evaluations

As a Member of Technical Staff, you will shape how coding agents are tested and improved. The work spans AI research, software engineering, and model evaluation: you will create benchmarks and datasets, study model failures, and build systems for experiments and evaluation. The role calls for at least three years of relevant technical experience and strong programming skills.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$8–$9/hr
  • Coding Agent Evaluation & Benchmark Design
  • Software Engineering & Python
  • LLM & Agentic Systems
Machine Learning & AIView job

Turing

Senior Software Engineer, AI Evaluation and Coding Agents

Evaluate and improve AI coding models by reviewing generated code.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
$100–$150/hr
  • python
  • typescript
  • javascript
Machine Learning & AIView job

Mercor

Applied Engineer, Evaluations

Build and refine software engineering evaluations from finished pull requests, then run them against frontier coding agents such as Claude Code and Codex. You’ll use an in-house framework alongside a research team that creates benchmarks for comparing large language models. The work covers repository selection, task design, automated grading, and repeated validation. Onboarding and ongoing review feedback support your start; afterward, you’ll own the work without step-by-step direction.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100–$120/hr
  • typescript
  • javascript
  • python
Software EngineeringView job