Software programmer Jobs in Waterloo, ON

Putting people first, every day

BDO is a firm built on a foundation of positive relationships with our people and our clients. Each day, our professionals provide exceptional service, helping clients with advice and insight they can trust. In turn, we offer an award-winning environment that fosters a with a high priority on your personal and professional growth.

Your Opportunity

We are seeking an experienced AI Engineer with a strong foundation in software engineering and a proven track record of building Generative and Agentic AI solutions. This new role is ideal for someone who thrives at the intersection of software development, applied AI research, and practical solution design. You will be responsible for designing, implementing, and deploying production-grade AI systems that leverage the latest in large language models (LLMs), orchestration frameworks, and agentic architectures.

Key Responsibilities

• Design & DevelopmentBuild scalable and robust AI-driven applications using LLMs and agentic frameworks.Implement vector database solutions to enable semantic search, RAG (retrieval augmented generation), and knowledge management.Develop orchestration pipelines with frameworks like LangChain, Semantic Kernel, AutoGen, or emerging agentic frameworks such as Agno and Parlant.
• Automation & IntegrationIntegrate workflow automation platforms (n8n, dify.ai Power Automate, etc.) with AI systems to deliver end-to-end business solutions.Ensure seamless integration with existing enterprise software ecosystems and APIs.
• Quality & EvaluationApply or contribute to LLM evaluation methodologies, leveraging platforms like Arize, DeepEval, or IBM WatsonX for model benchmarking, monitoring, and continuous improvement.Establish best practices for testing, performance tuning, and evaluation of agentic/LLM-based workflows.
• Collaboration & DeliveryWork closely with cross-functional teams including data scientists, software engineers, and product owners.Translate business requirements into technical designs and deliver working AI-powered applications in production environments.

Required Skills & Qualifications

• Strong background in software engineering (e.g., system design, distributed systems, APIs, CI/CD).
• Proven experience in building Generative AI and/or agentic systems.
• Hands-on expertise with:LLMs and model fine-tuning or integration.Vector databases (e.g., Pinecone, Weaviate, Milvus, FAISS, etc.).LLM orchestration frameworks (LangChain, Semantic Kernel, AutoGen, etc.).Agentic frameworks (Pydantic AI, Agno, Parlant, or similar).
• Proficiency in at least one major programming language such as Python or .NET (strong engineering fundamentals matter more than specific syntax).
• Hands-on experience architecting, deploying, and operating cloud-native solutions on one or more major hyperscale platforms (Azure, AWS, or GCP)
• Experience with workflow automation tools like n8n, dify.ai, Power Automate, or similar platforms.

Nice-to-Have Skills

• Familiarity with LLM evaluation frameworks (Arize, DeepEval, IBM WatsonX).
• Contributions to open-source AI frameworks or communities.
• Experience in MLOps, monitoring, and model deployment pipelines.

Who You Are

• A problem-solver with strong engineering rigor and curiosity for cutting-edge AI.
• Comfortable moving between architecture, coding, and deployment.
• Passionate about transforming abstract business needs into intelligent, production-ready systems.

.