Job Description
**Overview**
Join our team AIInfra, where we are building the AI data-plane that powers all LLM inferencing workloads across Microsoft and Azure customers—from cutting-edge startups to Fortune 500 enterprises. Our converged AI fabric delivers inference capabilities for all LLMs in Microsoft catalog (https://azure.microsoft.com/en-us/products/ai-model-catalog#Models) , including OpenAI, Anthropic, Mistral, Cohere, Llama, and more.
**Job Summary**
As a Principal Software Manager – Ai data-plane, you will shape the future of one of the largest and fastest-growing services in Azure, foundational to Microsoft’s AI strategy. Our mission is to serve models at scale—reliably, efficiently, and with ultra-low latency—enabling a rich set of AI-powered product experiences.
This is a rapidly evolving space with immense opportunities to learn, innovate, and drive industry-wide impact! You will lead a 50 person team to deliver products at scale wit...
Join our team AIInfra, where we are building the AI data-plane that powers all LLM inferencing workloads across Microsoft and Azure customers—from cutting-edge startups to Fortune 500 enterprises. Our converged AI fabric delivers inference capabilities for all LLMs in Microsoft catalog (https://azure.microsoft.com/en-us/products/ai-model-catalog#Models) , including OpenAI, Anthropic, Mistral, Cohere, Llama, and more.
**Job Summary**
As a Principal Software Manager – Ai data-plane, you will shape the future of one of the largest and fastest-growing services in Azure, foundational to Microsoft’s AI strategy. Our mission is to serve models at scale—reliably, efficiently, and with ultra-low latency—enabling a rich set of AI-powered product experiences.
This is a rapidly evolving space with immense opportunities to learn, innovate, and drive industry-wide impact! You will lead a 50 person team to deliver products at scale wit...
Ready to Apply?
Submit your application today and join our talented team at Microsoft Corporation.
Submit ApplicationJob Details
- Location Hyderabad, India
- Job Type Full-time
- Category other-general
- Posted Date June 29, 2026
- Application Deadline July 04, 2026