Platform Engineer - AI/ML Infrastructure

Platform Engineer - AI/ML Infrastructure

Location: Halifax, NS
Work Model: Onsite / 4 Days
Job Type: Full Time

Primary Skills

Kubernetes, GitOps (Flux CD/ArgoCD), Helm & Vault

Job Description

We are seeking a skilled Platform Engineer - AI/ML Infrastructure to deploy, manage, and support AI/ML infrastructure across enterprise Kubernetes environments. The role will focus on deploying platforms such as LlamaIndex Cloud and KDB.AI and building reliable, scalable, secure deployment pipelines using modern GitOps practices.

The ideal candidate will have strong experience managing production Kubernetes environments, developing Helm charts, implementing GitOps workflows, managing secrets with HashiCorp Vault, and maintaining enterprise CI/CD infrastructure.

Key Responsibilities

• Deploy and manage LlamaIndex Cloud, KDB.AI, and similar AI/ML applications across Dev, QA, and Production environments.
• Implement automated GitOps workflows using Flux CD, ArgoCD, or similar tools.
• Administer and maintain production Kubernetes clusters across multiple environments.
• Configure and manage HashiCorp Vault for secrets management and ExternalSecrets integration.
• Maintain CI/CD pipelines using GitHub Actions, Jenkins, or similar platforms.
• Collaborate with the Enterprise Identity Management team to configure OIDC authentication with Microsoft Entra ID.
• Create, maintain, and optimize Helm charts and Kubernetes manifests.
• Configure Kubernetes networking, Ingress, and Gateway API components.
• Monitor application and infrastructure performance and troubleshoot production issues.
• Support database and middleware infrastructure, including PostgreSQL, MongoDB, Redis, and RabbitMQ.
• Implement and maintain database high availability and failover configurations, including PgBouncer and HAProxy.
• Develop and maintain infrastructure documentation, procedures, runbooks, and reusable infrastructure patterns.
• Identify opportunities to improve platform reliability, automation, scalability, and operational efficiency.

Required Skills & Experience Core Technologies

• 3+ years of experience managing production Kubernetes clusters.
• 2+ years of experience with Flux CD, ArgoCD, or similar GitOps tools.
• Advanced experience developing and managing Helm charts.
• Hands-on experience with HashiCorp Vault and secrets management.
• Experience with Artifactory or similar container registries.
• Strong experience with CI/CD pipelines, particularly GitHub Actions, Jenkins, or equivalent tools.

Infrastructure & Database

• Experience administering PostgreSQL, MongoDB, Redis, and RabbitMQ.
• Knowledge of database HA/failover configurations, including PgBouncer and HAProxy.
• Strong Linux/Unix administration and shell scripting skills using Bash and/or PowerShell.
• Knowledge of Kubernetes networking, Ingress, and Gateway API.
• Experience troubleshooting production infrastructure and application issues.

Nice to Have

• Experience with LlamaIndex, LangChain, or other AI/ML platforms.
• Knowledge of vector databases and KDB.AI.
• Experience with Temporal.io workflow orchestration.
• Programming/scripting experience with Python and/or Go for automation.
• Exposure to AI/ML infrastructure deployment and operational practices.