Principal Engineer for AI Inference Systems

Medium
📍 toronto, on, Canada 💼 Full-time 🕒 Posted June 27, 2026

Job Description

Lead the development of advanced AI inference systems as a Principal Engineer. Design and implement robust platforms for agentic functionality across multiple data modalities.

In this pivotal role, you will leverage your extensive experience in AI system architecture to integrate cutting-edge agent technologies. Your focus will include building operational frameworks, securing robust interactions, and improving model deployment processes. Collaborating with various technical teams, you will ensure optimal performance while adhering to security best practices.

Key Responsibilities: • Define architecture for agentic AI frameworks • Implement and manage model serving solutions • Optimize inference for efficiency and reliability • Build coordination systems for enhanced agent collaboration • Create tools and practices for development and safety checks

Requirements: • Over 8 years of software engineering expertise • 3+ years engaging with AI and LLM implementation...

Ready to Apply?

Submit your application today and join our talented team at Medium.

Submit Application

Job Details

  • Location toronto, on
  • Job Type Full-time
  • Category Other-General
  • Posted Date June 27, 2026
  • Application Deadline August 06, 2026