AI Platform Engineering Manager

Description

Summary: Seeking an AI Platform Engineering Manager to lead the AI Enablement team, overseeing enterprise AI infrastructure development, scaling, and maintenance, driving innovation in platform engineering, MLOps, and Agentic AI. Highlights: 1. Lead AI Enablement team and drive innovation in AI infrastructure 2. Oversee development and maintenance of scalable Agentic AI platforms 3. Focus on MLOps, platform engineering, and Agentic AI We are seeking a dynamic and experienced **AI Platform Engineering Manager** to lead our AI Enablement team. In this role, you will oversee the development, scaling, and maintenance of enterprise AI infrastructure, driving innovation at the intersection of platform engineering, MLOps, and Agentic AI. **Responsibilities** * Develop and maintain the organization's agentic AI platform and ensure its scalability and reliability * Oversee LiteLLM as the central AI gateway, focusing on LLM routing, cost control, load balancing, and failover mechanisms * Design and optimize Retrieval\-Augmented Generation (RAG) pipelines, including ingestion, chunking, embeddings, and vector stores * Manage RAG infrastructure on GCP and Azure using managed AI services and vector databases * Deploy and manage AI services on Kubernetes platforms such as AKS and GKE * Implement CI/CD pipelines with tools like Jenkins, Opsera, and GitHub Actions * Automate infrastructure provisioning and management using Terraform, Helm, and GitOps * Ensure security, compliance, and robust monitoring using tools like Prometheus, Grafana, and OpenTelemetry * Enable multi\-agent orchestration and autonomous workflows through custom tool integrations * Develop SDKs, APIs, and comprehensive developer documentation for internal stakeholders * Build and manage MCP servers to enable seamless tool integration with AI workflows **Requirements** * 8\+ years of experience in platform engineering or DevOps roles * 4\+ years of experience with AI/ML or LLM\-focused platforms * Strong expertise in Kubernetes, CI/CD platforms (e.g., Jenkins, GitHub Actions), and cloud providers (GCP or Azure) * Proficiency in Python and/or TypeScript * Familiarity with automation and orchestration tools like Terraform, Helm, and GitOps * Advanced proficiency in English (C1\+) **Nice to have** * Background in LangChain, LlamaIndex, or other agent frameworks * Familiarity with technologies like LiteLLM, MCP, and Backstage * Expertise in cost optimization strategies for LLM workloads * Experience managing enterprise\-scale AI platforms and supporting large\-scale deployments