Talent.com
Astra North Infoteck Inc.
Senior AI Engineer – JVM Engineering (Java/Kotlin), Knowledge Graphs, MCPAstra North Infoteck Inc. • Toronto, ON, ca
Senior AI Engineer – JVM Engineering (Java/Kotlin), Knowledge Graphs, MCP

Senior AI Engineer – JVM Engineering (Java/Kotlin), Knowledge Graphs, MCP

Astra North Infoteck Inc. • Toronto, ON, ca
1 day ago
Job type
  • Full-time
Job description

Job Description

Role: Senior AI Engineer

Work Schedule: Hybrid, Tuesday to Thursday, 8:30 AM to 5:00 PM EST (3 days per week required in office)

We are looking for an experienced and highly motivated Senior AI Engineer to join the Technology Strategy team.

In this role, you will design and build the agentic workflow that breaks a complex analytical engagement into stages, coordinates large language models and tools, and keeps every result grounded in source evidence. You will be accountable for how the system stores and retrieves knowledge, how it exposes its capabilities to other agents and assistants, and how it proves that what it produces is faithful to the source.

Position Responsibilities

You are an expert in agentic systems, knowledge graphs, AI-enabled document generation and rendering, with extensive knowledge in cloud infrastructure, the AI service stack, CI/CD, and observability. You will work closely with engineering and business partners to deliver an AI system that is accurate, explainable, safe to operate, and presentable to the business.

1. Design and build the agentic analysis workflow

• Model a long-running, multi-stage analytical workflow as a sequence of AI-agent steps that can pause, resume, and recover without losing work.

• Orchestrate large language models and tools (retrieval, calculation, rules, and structured extraction) into reliable, traceable steps.

• Engineer prompts and structured-output contracts so each step returns validated, machine-usable results rather than free text.

• Build on an event-sourced service framework (for example, the Akka SDK) where state, decisions, and evidence are persisted at every step.

2. Build and operate the knowledge graph

• Design and run the knowledge graph that stores entities, relationships, and provenance extracted from the source corpus (for example, Neo4j or MongoDB Atlas).

• Build the ingestion and extraction pipeline that turns raw documents into a validated, queryable graph, with every fact citing its source.

• Implement graph-based and vector retrieval (GraphRAG and embeddings) so agents answer from grounded evidence rather than memory.

3. Expose capabilities through open agent interfaces

• Build Model Context Protocol (MCP) tool servers and agent-to-agent (A2A) interfaces, so the system's capabilities are available to external assistants and to larger multi-agent workflows.

• Integrate with MCP-compatible clients and low-code agent builders, for example Microsoft Copilot Studio agents, so business users can query the graph and trigger analysis conversationally.

• Build a conversational interface that answers questions strictly from the grounded knowledge graph.

4. Set a high bar for grounding, evaluation, and safety

• Implement anti-hallucination controls: every output statement traces to a cited source, and anything unsupported is flagged or withheld.

• Build automated evaluation (section-level scoring, regression tests, edge-case coverage, and human-review rubrics) and turn it into clear acceptance criteria.

• Add guardrails for prompt injection, data minimization, and safe output, with explicit human-in-the-loop checkpoints, and produce the evidence that AI and model-governance review will ask for.

5. Get it to production, and keep it there

• Own the path from code to production: build and deployment pipelines, environment configuration, secrets, and access, on an enterprise container and agent-hosting platform.

• Work with the cloud AI building blocks the system depends on: managed model endpoints, search and retrieval, document storage, document intelligence (OCR), and the graph datastore.

• Put logging, metrics, tracing, and alerting across the workflow, define health checks and recovery for long-running jobs that must resume after failure, and watch the cost, latency, and rate limits of model and retrieval calls before they become an incident.

6. Stand behind the deliverables

• Own the data contract between the analytical layer and the rendering layer, so structured output maps cleanly onto rendered components.

• Keep generation deterministic and testable: the same input produces the same document, so a regression fails the build instead of surfacing in a business review.

• Work with the rendering toolchain (for example Apache POI, PDFBox, or pptxgenjs) closely enough to diagnose a broken deliverable, extend a template, and hold the line on structural fidelity: required sections, tables, ordering, and cross-format consistency.

Required Qualifications

• 6-10 years building production software, including recent hands-on delivery of AI or large-language-model systems beyond prototypes.

• Strong JVM engineering (Java; Kotlin or Scala a plus) with solid practices: Git workflows, code review, automated testing, structured logging, and clean design.

• Hands-on experience with modern GenAI patterns: prompt engineering, structured or JSON outputs, tool and function calling, retrieval-augmented generation, and agentic workflows.

• Experience designing and querying a graph or document database (Neo4j and Cypher, or MongoDB Atlas) and using vector search and embeddings for semantic retrieval.

• A track record of owning your own delivery path: you have taken something you built through a pipeline into production and operated it, rather than handing it over.

• Practical experience evaluating non-deterministic systems: test design, quality scoring, regression suites, and translating evaluation into business-ready acceptance criteria.

• Demonstrated ability to design and explain solution architecture (data flow, runtime flow, interfaces, failure modes, and controls) and to explain model behaviour, limitations, and trade-offs in plain language.

Adjacent Areas

• Platform and reliability: a major cloud (Azure preferred), containerized deployment with Docker and Kubernetes, CI/CD, observability, and automated quality gates on a service you ran in production.

• Deliverable generation and




Requirements
Java

Create a job alert for this search

Senior AI Engineer – JVM Engineering (Java/Kotlin), Knowledge Graphs, MCP • Toronto, ON, ca

Similar jobs

Senior Software Engineer, AI

KlueToronto, ON, CA
Full-time

Senior Machine Learning Engineer.Toronto, focusing on building and optimizing state-of-the-art LLM-powered agents that can reason, plan and automate workflows for users.You will be leading the desi... Show more

 • Promoted

Senior C++ Engineer in AI Technologies

QualcommMarkham, Ontario, Canada
Full-time

Join Qualcomm Canada as a Senior C++ Engineer focusing on AI technologies.Shape the future of machine learning applications through innovative software solutions and frameworks.As part of Qualcomm’... Show more

 • Promoted

Okta Senior Engineer for AI Solutions

OktaToronto, Ontario, Canada
Full-time

Leverage your backend expertise as a Senior Software Engineer at Okta, advancing identity security for GenAI applications using TypeScript and Node.Join a leading innovator in secure AI environment... Show more

 • Promoted

Remote AI Engineer - Build Next-Gen ML Solutions

Yeah! GlobalToronto, ON, CA
Remote
Full-time

A global technology firm is seeking highly skilled AI Engineers to join their team.This remote position requires proficiency in programming languages like Python and experience in developing AI mod... Show more

 • Promoted

Senior Ai Engineer - C$152,000 - C$175,000 A Year

LeagueToronto, Canada
Full-time

Seeking a Senior AI Engineer to design, build, and scale AI systems, focusing on LLM productionization and MLOps within the healthcare CX platform. Show more

 • Promoted

Senior AI Architect for Innovative Tech

Spencer Scott - Technology RecruitmentToronto, ON, CA
Full-time

Become a Senior AI Software Engineer at a pioneering tech company focused on developing innovative AI features.Collaborate with product teams to enhance customer experiences.This hands-on role invo... Show more

 • Promoted

AI Engineer Co-op Role at Huawei

Huawei CanadaMarkham, ON, CA
Full-time

Become a Co-op Engineer focused on Mobile AI with Huawei Canada’s Noah's Ark lab for an 8-16 month term.This position allows you to work on innovative AI applications in mobile technology.Ideal can... Show more

 • Promoted

AI Software Engineer — ROCm & GPU Innovation

AMDMarkham, York Region, CA
Full-time

A leading semiconductor company in Markham is seeking a Software Development Engineer to focus on innovative AI software features.The role involves validating and releasing software, contributing t... Show more

 • Promoted

Senior Backend Engineer AI Toronto

ToastToronto, ON, CA
Full-time

Enhance your career as a Senior Software Engineer, AI in Toronto, focusing on backend solutions that empower LLM applications.Transform user data into actionable insights.In this prominent role, yo... Show more

 • Promoted

Senior Developer (Ai/Ml/Gen Ai Solutions) - C$104,000 - C$154,000 A Year

TelusToronto County, Canada
Full-time

Seeking a Senior Full Stack Developer with AI/ML/Gen AI expertise to lead cross-functional teams in designing and implementing intelligent applications, mentor junior developers, and drive technica... Show more

 • Promoted

Senior Engineer - Generative AI

Rubicon PathToronto, ON, CA
Full-time

About the job Senior Engineer - Generative AI.Our client in the financial service space in Toronto is looking for a Senior Engineer with experience in Generative AI.Bachelors degree in Computer Sci... Show more

 • Promoted

Senior Voice AI Software Engineer Opportunity

SoundHound Inc.Toronto, ON, CA
Full-time

Advance your career as a Senior Voice AI Software Engineer with SoundHound AI, working to transform restaurant experiences through innovative menu solutions.Hybrid workplace options available.Play ... Show more

 • Promoted

Senior Engineer - Generative Ai

Rubicon PathToronto, Canada
Full-time

About the job Senior Engineer - Generative AIOur client in the financial service space in Toronto is looking for a Senior Engineer with experience in Generative AI.Qualifications:Bachelors degree i... Show more

 • Promoted

Senior AI/ML Applications Architect

GE Vernovamarkham, on, Canada
Full-time

GE Vernova is accelerating the path to more reliable, affordable, and sustainable energy, while helping our customers power economies and deliver the electricity that is vital to health, safety, se... Show more

 • Promoted • New!

Hybrid Senior Java Engineer at Agentic AI

Princeton IT Services, IncToronto, Ontario, Canada
Full-time

Empower your career as a Senior Java Engineer at Agentic AI in Toronto with a hybrid work model.This role demands innovation in a technology-driven environment.Agentic AI is on the lookout for a Se... Show more

 • Promoted

Remote Forward-Deployed Engineer: AI-Driven Modernization

Banyan SoftwareToronto, ON, CA
Remote
Full-time

A leading software company is seeking a Forward Deployed Engineer to drive the modernization of applications with a focus on AI-assisted software development practices.This hybrid role requires ove... Show more

 • Promoted

High-Performance JVM & VM Engineer

IBMMarkham, York Region, CA
Full-time

A leading global technology company is seeking a Mid-Senior level engineer to join their team focusing on the Java Virtual Machine (JVM).The role involves optimizing Garbage Collection algorithms a... Show more

 • Promoted

Senior Java Gen AI Engineer - Azure Hybrid

Compunnel Inc.Toronto, ON, CA
Full-time

An innovative company is seeking a Senior Java Gen AI Developer to join their dynamic team in Toronto.This role offers the opportunity to work on cutting-edge Gen AI products utilizing Azure's powe... Show more

 • Promoted

Ai Engineer - $120,000 - $200,000 A Year

OpenSesameEast York, Canada
Full-time

AI Engineer needed to design and scale backend systems for SMS-based AI agents in the insurance industry, focusing on reliability, accuracy, and performance. Show more

 • Promoted

Senior Software Engineer - AI-First Vehicle Platform

Toronto Film SchoolToronto, ON, CA
Full-time

A leading tech company in Toronto is seeking an experienced developer who thrives in building impactful systems.The role involves designing and shipping core systems end-to-end, solving complex pro... Show more