AIWorkJobs
Mercor logoMercorPlatform listing

MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)

Work on AI model training and evaluation by creating and reviewing ML systems tasks and solutions for frontier AI models. The role centers on LLM infrastructure, with work across accelerator kernels, performance…

Remote · Eligibility not specifiedHourly
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Hourly
Compensation
$90–$120/hr
Specialty
Machine Learning & AI
Weekly commitment
40 hours per week

About the role

Work on AI model training and evaluation by creating and reviewing ML systems tasks and solutions for frontier AI models. The role centers on LLM infrastructure, with work across accelerator kernels, performance profiling, distributed workload debugging, and high-throughput inference serving. Candidates worldwide can work remotely through Cincinnatus LLC or a local employer-of-record partner. The engagement requires 40 hours per week on weekdays, with no other engagements.

What you would do

  • Create challenging tasks and accurate solutions covering kernels, profiling, debugging, and inference serving, including adversarial problems that test model performance on accelerator code such as Pallas kernels on TPU.
  • Help research and engineering teams address knowledge gaps in ML systems, compilers, and training infrastructure.
  • Review ML systems tasks and solutions, then provide clear technical feedback that can withstand expert scrutiny.
  • Write guidelines and detailed rubrics for kernel optimization, profiler output interpretation, distributed systems reasoning, and serving throughput and latency trade-offs.
  • Work with other subject matter experts to maintain accurate, consistent training data.

Requirements

  • At least 2 years of hands-on professional experience in ML systems, ML infrastructure, model serving, or accelerator performance engineering.
  • Practical experience in at least one area: custom kernel development or optimization, performance profiling and trace analysis, debugging distributed or accelerator-bound workloads, or large-scale LLM serving.
  • Production experience with JAX, PyTorch, or both.
  • Experience with modern accelerators such as TPU v4 to v6e, H100, B200, Trainium, or MI300, and the ability to reason about throughput, latency, and memory trade-offs.
  • A clear record of career progression.
  • Availability for at least 40 hours per week on weekdays, without other engagements.
  • Strong written communication skills and the ability to explain complex technical decisions.

Preferred qualifications

The source marks these as preferred, not required.

  • Practical experience across more than one of the listed ML systems areas.
  • Experience with JAX, XLA, or TPUs.
  • Framework-level expertise such as custom operators, sharding and distributed training with pjit, shard_map, FSDP, Megatron, or MaxText, or compiler and graph work with XLA, StableHLO, torch.compile, or MLIR.

Who should apply

The ideal candidate has hands-on ML systems experience and can contribute in at least one area of kernel work, profiling, workload debugging, or LLM serving. Candidates should also have production experience with JAX or PyTorch and be available for a 40-hour weekday engagement without other work commitments.

How applying works on Mercor

Create a profile, complete the role checklist and AI interview, then verify your identity before a project offer.

  1. Create an account and confirm your résumé.
  2. Complete the role checklist, written assessment, and AI interview where the listing requires them.
  3. Submit the application and wait for review or matching.
  4. Complete a work trial and identity verification before onboarding.

Typical timeline: The AI interview is about 20 minutes; work trials are often 4–6 hours; identity checks are usually minutes.

Paid steps: The work trial is paid.

Assessment and interview requirements vary by role. Check the checklist inside the specific listing.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Mercor process and its official source on the Mercor page.

Skills mentioned by the source

  • mlops
  • large language models
  • ml systems
  • accelerator kernels
  • pallas
  • triton
  • cuda
  • cutlass
  • performance profiling
  • trace analysis
  • jax
  • xla
  • pytorch
  • distributed systems
  • llm inference serving
  • vllm

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: mlops-engineer-llm-performance-kernels-profiling-serving-5Nkon1. Source: Mercor. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

AfterQuery

Software/ML Engineer

Help assess how well AI models handle real challenges in LLM inference, GPU performance, and model-serving architecture. You’ll create technical evaluation scenarios, develop reference solutions, and review model responses against clear standards for correctness and quality. The work centers on research and evaluation, not production software development, and offers a flexible schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$125/hr
  • llm inference
  • gpu inference optimization
  • cuda
Machine Learning & AIView job

micro1

ML Engineer

Contribute to an AI training project by building, testing, and assessing machine-learning engineering tasks. Work covers model development, training and inference workflows, numerical computing, and performance tuning. This contractor role averages about 15 hours per week, with flexible days and hours, including weekends if you choose. Pay depends on completed tasks that meet project specifications, and minimum submission requirements apply.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$60–$120/hr
  • Machine Learning
Machine Learning & AIView job

Mercor

Scientific / ML Engineer

Work on AI training data by creating and reviewing technical problems in machine learning and scientific computing. You will assess model training, experiments, data pipelines, and simulations, then provide solutions and feedback grounded in sound methodology. Cincinnatus LLC employs this part-time W-2 role and may place you with a leading AI lab as part of its extended workforce.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$90–$140/hr
  • machine learning
  • scientific computing
  • python
Machine Learning & AIView job

Turing

LLM Java Developer

Develop and maintain Java code for training and optimizing AI models.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • java
  • large language models
  • llm evaluation
Machine Learning & AIView job