Ai gateway engineer

About the Company
We are seeking a skilled AI Gateway Engineer to join our team. The ideal candidate will have hands-on experience with AI or API gateways, a strong background in backend development, and expertise in deploying and optimizing AI/ML models in a production environment. You will be instrumental in building and scaling our AI infrastructure within an enterprise-grade setting.
About the Role
Key Responsibilities:
Design and manage AI/API gateways like Kong, Mosaic, or Portkey.
Develop and maintain backend services, primarily using Go, with Python as a valuable secondary skill.
Optimize and productize AI/ML models for production use, ensuring performance, scalability, and reliability.
Leverage AWS to build and manage our cloud infrastructure.
Implement and manage observability tools, including Open Telemetry (OTel), Grafana, and Prometheus, to monitor system health and performance.
Apply prompt engineering techniques to improve the efficien...

Ready to Apply?

Submit your application today and join our talented team at AVM Consulting Inc.

Submit Application