AIWorkJobs
AfterQuery logoAfterQueryPlatform listing

Software/ML Engineer

Help assess how well AI models handle real challenges in LLM inference, GPU performance, and model-serving architecture. You’ll create technical evaluation scenarios, develop reference solutions, and review model…

Remote · Eligibility not specifiedNot specified
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Not specified
Compensation
$125/hr
Specialty
Machine Learning & AI

About the role

Help assess how well AI models handle real challenges in LLM inference, GPU performance, and model-serving architecture. You’ll create technical evaluation scenarios, develop reference solutions, and review model responses against clear standards for correctness and quality. The work centers on research and evaluation, not production software development, and offers a flexible schedule.

What you would do

  • Create realistic technical scenarios and problem sets focused on LLM inference optimization, GPU kernel design, and systems performance engineering.
  • Write reference solutions for the evaluation problems.
  • Grade model outputs against the technical problems.
  • Set standards for what counts as a correct and high-quality response.

Requirements

  • Bachelor’s degree or higher in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • Hands-on experience in at least one area: GPU inference optimization, custom CUDA kernel development, model-serving systems, quantization, or optimizer design.
  • Experience with a recognized technology or AI company in a role that included ownership of systems engineering.
  • Strong written communication skills for authoring technical explanations and feedback.

Preferred qualifications

The source marks these as preferred, not required.

  • Direct experience with SGLang, Mamba or Mamba2 architectures, or IBM Granite-family models.
  • Open-source contributions to inference or serving frameworks such as vLLM, SGLang, or TensorRT-LLM.
  • Experience with distributed inference, including tensor or expert parallelism, continuous batching, or KV-cache optimization.

Who should apply

The role suits software and ML engineers with systems-engineering ownership and hands-on expertise in inference, GPU kernels, model serving, quantization, or optimizer design. Strong technical writing matters because you’ll explain and evaluate model responses.

How applying works on AfterQuery

Create an account, complete an interview and a domain assessment, then get matched to a project.

  1. Create an account and submit the short application.
  2. Complete a live or asynchronous video interview.
  3. Pass a short domain skills assessment.
  4. Get matched to a project and begin work.

Paid steps: Not stated by the source

Assessment requirements and payment setup can vary by project.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full AfterQuery process and its official source on the AfterQuery page.

Skills mentioned by the source

  • llm inference
  • gpu inference optimization
  • cuda
  • model serving
  • vllm
  • tensorrt-llm
  • sglang
  • quantization
  • optimizer design
  • distributed inference
  • tensor parallelism
  • expert parallelism
  • continuous batching
  • kv-cache optimization

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: softwareml-engineer-421052. Source: AfterQuery. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

AfterQuery

ML Research Engineer — Inference & GPU Kernels

AfterQuery is assembling senior experts in ML inference and GPU kernel engineering to assess how frontier AI models handle difficult, real-world technical problems. You’ll define standards for correct, high-quality work through research and evaluation, not production engineering. The role spans inference serving, kernel optimization, and large-model deployment infrastructure, and calls for 6–10 years of experience plus a PhD or a master’s degree with a strong research record.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • machine learning
  • ml inference
  • gpu kernels
Machine Learning & AIView job

Mercor

MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)

Work on AI model training and evaluation by creating and reviewing ML systems tasks and solutions for frontier AI models. The role centers on LLM infrastructure, with work across accelerator kernels, performance profiling, distributed workload debugging, and high-throughput inference serving. Candidates worldwide can work remotely through Cincinnatus LLC or a local employer-of-record partner. The engagement requires 40 hours per week on weekdays, with no other engagements.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$90–$120/hr
  • mlops
  • large language models
  • ml systems
Machine Learning & AIView job

micro1

ML Engineer

Contribute to an AI training project by building, testing, and assessing machine-learning engineering tasks. Work covers model development, training and inference workflows, numerical computing, and performance tuning. This contractor role averages about 15 hours per week, with flexible days and hours, including weekends if you choose. Pay depends on completed tasks that meet project specifications, and minimum submission requirements apply.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$60–$120/hr
  • Machine Learning
Machine Learning & AIView job

Turing

Senior Software Engineer – LLM Evaluation

Evaluate and refine AI-generated code for efficiency and reliability.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job