Software Development Manager, LLM Inference Model Enablement, Neuron SDK

Amazon
📍 Cupertino, CA, United States 💼 Full-time 🕒 Posted July 04, 2026

Job Description

Description
DESCRIPTION
AWS Utility Computing (UC) provides product innovations, from foundational services such as Amazon Elastic Compute Cloud (EC2), to new product innovations that continue to set AWS’s services and features apart in the industry.

We develop AWS Neuron, the complete software stack for Trainium, Amazon's custom cloud-scale
machine learning accelerators. Come optimize LLMs such as Llama and GPT-OSS to run really fast on Trainium.

As the SDM for the LLM Inference Model Enablement team, you will lead a team of expert AI/ML engineers to onboard and optimize state-of-the-art open-source and customer LLMs, both dense and MoE, for inference on Neuron and Trainium and Inferentia accelerators. You will also drive improvements in model enablement speed and experience, while advancing inference usability and quality through inference features, infrastructure optimization, tools, and automation.

The ideal candidate will have a strong backgroun...

Ready to Apply?

Submit your application today and join our talented team at Amazon.

Submit Application

Job Details

  • Location Cupertino, CA
  • Job Type Full-time
  • Category other-general
  • Posted Date July 04, 2026
  • Application Deadline July 09, 2026