AIWorkJobs
Braintrust logoEtsyListed on Braintrust

Software Engineer (Scala + ML Systems) US Only

Build and operate Etsy’s ML orchestration platform, the gateway for model requests across search, recommendations, ads, trust and safety, and generative AI. You’ll work on online inference and model evaluation in a…

Remote · United States onlyContract
Work arrangement
Remote
Eligibility
United States only
Engagement
Contract
Compensation
$80–$84/hr
Specialty
Machine Learning & AI
Experience
5–10 years

About the role

Build and operate Etsy’s ML orchestration platform, the gateway for model requests across search, recommendations, ads, trust and safety, and generative AI. You’ll work on online inference and model evaluation in a high-scale, latency-sensitive system that connects product teams with models, features, and serving infrastructure. The platform supports Applied Scientists and Software Engineers as they move models from experiments into production.

What you would do

  • Build and run Etsy’s ML orchestration platform for product teams across the company.
  • Support online inference and model evaluation for search, recommendations, ads, trust and safety, and generative AI use cases.
  • Connect product teams with models, features, and model-serving infrastructure.
  • Design service APIs and request-routing or orchestration systems, including systems that use gRPC or queues.
  • Operate Kubernetes services, including deployments, scaling, resource management, and production debugging.
  • Monitor and improve service operations through metrics, tracing, alerting, on-call ownership, and performance profiling.
  • Work with Applied Scientists, Data Enablement, model serving and LLM hosting teams, and product engineering partners to understand internal user needs.
  • Use generative AI and other productivity tools with thoughtful judgment and an emphasis on learning and intentional contribution.

Requirements

  • At least 5 years of software engineering experience building and operating distributed, low-latency production services.
  • Back-end engineering experience working on ML systems, with knowledge of how machine learning works.
  • Expertise in Scala and familiarity with functional programming patterns such as immutability, composition, and effect or concurrency libraries.
  • Understanding of production ML inference, including model serving, feature retrieval, batching, latency and throughput trade-offs, and deployment and evaluation of predictive and transformer-based models.
  • Hands-on experience operating services on Kubernetes, including deployment, scaling, resource management, and production debugging.
  • Experience designing service APIs and request-routing or orchestration systems, such as those using gRPC or queues.
  • Operational experience with metrics, tracing, alerting, on-call ownership, and performance profiling.
  • A product mindset and strong communication skills, including experience understanding the needs of internal users.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience with cloud infrastructure, ideally GCP.
  • Experience with model-serving frameworks or LLM inference infrastructure such as vLLM, Triton, or KServe.
  • Experience with experimentation platforms, feature stores, or online evaluation systems.
  • Experience managing GPU capacity and optimizing costs.
  • Experience with Scala libraries and frameworks such as Cats Effect, ZIO, Akka/Pekko, or http4s.

Who should apply

Candidates with at least five years building distributed, low-latency services and hands-on back-end ML systems experience should consider this role. Strong Scala expertise and production Kubernetes operations experience are essential.

How applying works on Braintrust

Create a Braintrust profile, complete the AI skills interview, then browse and accept tasks from the dashboard.

  1. Create and complete a Braintrust profile.
  2. Complete the AI skills interview used for expertise and pay-level matching.
  3. Browse the dashboard for available tasks.
  4. Accept a task and complete the work.

Typical timeline: A new member profile takes about 20 minutes.

Paid steps: Not stated by the source

Individual client projects can add their own interview, assessment, or identity check.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Braintrust process and its official source on the Braintrust page.

Skills mentioned by the source

  • scala
  • kubernetes
  • machine learning
  • ml inference
  • model serving
  • feature retrieval
  • grpc
  • request routing
  • distributed systems
  • low-latency services
  • metrics
  • tracing
  • alerting
  • debugging
  • performance profiling
  • gcp

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: software-engineer-scala-ml-systems-us-only-18134. Source: Braintrust. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Etsy · via Braintrust

Software Engineer (Scala + ML Systems)

Build and operate Etsy’s central ML orchestration platform, which routes requests for search, recommendations, ads, trust and safety, and generative AI. The system supports online inference and model evaluation, connecting product teams with models, features, and serving infrastructure. Its scale, latency, and availability shape buyer and seller experiences. The role is onsite in New York, NY.

Location and eligibility
On-site · United States only
Engagement type
Contract
Compensation
$80–$84/hr
  • scala
  • functional programming
  • machine learning
Machine Learning & AIView job

SME Careers

Scala Engineer

Review AI-generated Scala code, architecture proposals, and technical explanations, then produce reference solutions that show sound engineering practice. You will judge answers for correctness, clarity, safety, and performance, with close attention to concurrency, distributed behavior, and JVM resource use. The role is remote and contract-based, and requires C1 English proficiency.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $70/hr
  • scala
  • scala 2.13
  • scala 3
Cloud & DevOpsView job

micro1

Software Engineer (Staff), Platform Engineering

As a hands-on Staff Software Engineer, you’ll shape and scale platforms for operations, AI data workflows, and intelligence systems. The work spans distributed backend services, data pipelines, workflow orchestration, and infrastructure for AI agents. You’ll write production code, guide architecture across teams, and build systems that support expert onboarding, AI model training and evaluation, and actionable insights.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$7–$8/hr
  • Platform Engineering & System Architecture
  • Agentic Engineering & AI Systems
  • Data Engineering & Pipeline Architecture
Machine Learning & AIView job

AfterQuery

Software/ML Engineer

Help assess how well AI models handle real challenges in LLM inference, GPU performance, and model-serving architecture. You’ll create technical evaluation scenarios, develop reference solutions, and review model responses against clear standards for correctness and quality. The work centers on research and evaluation, not production software development, and offers a flexible schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$125/hr
  • llm inference
  • gpu inference optimization
  • cuda
Machine Learning & AIView job