Talent.com
Astra North Infoteck Inc.
Senior Java Backend Engineer – GenAI / LLMAstra North Infoteck Inc. • Toronto, ON, ca
Senior Java Backend Engineer – GenAI / LLM

Senior Java Backend Engineer – GenAI / LLM

Astra North Infoteck Inc. • Toronto, ON, ca
6 days ago
Job type
  • Full-time
Job description

Job Description

Senior Java Backend Developer – Java 17+, Spring Boot, Microservices & GenAI/LLM


Toronto, ON - Hybrid (4 Days WFO)


Experience Required: 7+ years


Role Descriptions:


Key Responsibilities


• Design, develop, and maintain high-performance backend services using Java (17+), Spring Boot, and Microservices architecture.

• Build and expose RESTful and event-driven APIs supporting enterprise-scale applications.

• Integrate Generative AI / LLM capabilities (e.g., text generation, summarization, Q&A, classification) into backend workflows.

• Design, test, and optimize prompts and prompt orchestration strategies to ensure accuracy, determinism, and performance.

• Develop AI-aware backend components such as:

• Prompt templates and prompt pipelines

• Retrieval-Augmented Generation (RAG) services

• AI inference orchestration layers

• Implement secure API integrations with AI platforms and internal data sources, ensuring compliance with enterprise security standards.

• Apply prompt versioning, evaluation, and monitoring techniques to improve AI output quality over time.

• Ensure nonfunctional requirements: scalability, resiliency, performance, and observability.

• Contribute to CI/CD pipelines, containerization, and cloud-native deployments.

• Participate in code reviews, architecture discussions, and technical design decisions.

• Support production systems and troubleshoot complex backend or AI-integration issues.


Required Technical Skills


Core Backend Engineering


• 5+ years of strong hands-on experience in Java backend development.

• Expertise in Java 11/17+, Spring Boot, Spring MVC, Spring Security.

• Solid experience in Microservices, REST APIs, and API design (OpenAPI/Swagger).

• Experience with containers and cloud platforms (Docker, Kubernetes, OpenShift, Azure/AWS).

• Strong knowledge of SQL and NoSQL databases (e.g., DB2, PostgreSQL, MongoDB).

• Experience in CI/CD, DevOps practices, and automated testing.


AI & Prompt Engineering


• Hands-on experience integrating Large Language Models (LLMs) into backend systems.

• Strong understanding of prompt engineering techniques, including:

• Zero-shot, few-shot, and chain-of-thought prompting

• Prompt templates and dynamic prompt generation

• Guardrails, validation, and hallucination reduction

• Experience building RAG-based solutions using vector stores and embeddings.

• Familiarity with AI orchestration frameworks or SDKs (enterprise or open-source).

• Ability to evaluate prompt and model responses for quality, bias, and consistency.


Security & Compliance


• Experience implementing OAuth2.0, JWT, SSL/TLS, and secure API patterns.

• Awareness of data privacy, PII handling, and AI governance in regulated environments (BFSI preferred).



Requirements
Top 3 Required Skills: 1. IBM Financial transaction 2. Payment flow 3. Support Modernization Detailed Job Description: • Design, develop, and maintain applications built on IBM Financial Transaction Manager (FTM) to support core payments processing. • Contribute to the development of payment flows supporting transaction processing. • Build and support integrations between FTM and upstream/downstream systems using enterprise integration patterns. • Participate in the design, development, testing, deployment, and production support. • Troubleshoot and resolve application and integration issues in a complex, regulated environment. • Collaborate with architecture, QA, and operations teams to ensure platform stability, scalability, and performance. • Support modernization initiatives and enhancements to existing payment hub capabilities. • Produce clear technical documentation and participate in code reviews and knowledge sharing.

Create a job alert for this search

Senior Java Backend Engineer – GenAI / LLM • Toronto, ON, ca

Similar jobs

Senior Java Engineer - Capital Markets (Hybrid, Toronto)

ScotiabankToronto
Full-time

A leading bank in the Americas seeks an experienced Senior Software Engineer to join their Commodities Technology team in Toronto, Ontario.This role involves maintaining and upgrading software comp... Show more

 • Promoted

Senior Java Software Engineer

Iris Software Inc.Toronto
Full-time

Iris's Fortune 100 direct client is looking.Please find below Job description and share me your updated resume at.Location: Toronto, ON (Hybrid, 4 days onsite in a week).Bachelor’s degree in Comput... Show more

 • Promoted

Senior Java Engineer for Cloud Solutions

Nue.ioToronto, ON, CA
Full-time

Harness your skills at Nue as a Senior Java Engineer, focusing on developing large-scale cloud solutions.Engage with modern technologies like AWS and event streaming platforms.Nue seeks a Senior So... Show more

 • Promoted

Senior Backend Engineer

VennToronto
Full-time

Venn is the fastest-growing B2B fintech in Canada.We're on a mission to transform business banking for Canadian entrepreneurs and are looking to hire A-players interested in disrupting traditional ... Show more

 • Promoted

Hybrid Senior Backend Engineer: Distributed Systems & Cloud - C$107,000 - C$157,300 A Year

Autodesk, Inc.Toronto County, Canada
Full-time

Seeking a Senior Backend Engineer to work on a distributed computing platform, involving coding, design, and production support.Requires backend experience with Go, Python, or Java and AWS. Show more

 • Promoted

Senior Java Engineer

Princeton IT Services, IncToronto, Ontario, Canada
Temporary

Senior Java Engineer Agentic AI.Toronto, ON (Hybrid 3 days/week onsite).About The Role We are looking for highly experienced, hands-on Senior Java Engineers (Architects /Technical Leads) with a str... Show more

 • Promoted

Senior Backend Engineer: Database & Java Specialist

Alert DrivingToronto
Full-time

A software development company in Toronto is seeking an experienced Backend Application Developer to drive the development of database-centric web applications.In this role, you will design and imp... Show more

 • Promoted

Senior Backend Engineer – Java & Blockchain (Remote) - C$175,000 - C$205,000 A Year - Remote

Binance.USNorth York, Canada
Remote
Full-time

Senior Backend Engineer sought to design and maintain high-throughput backend services for a crypto platform. Show more

 • Promoted

Senior Java Backend Engineer - Microservices & Apis - C$85,000 - C$125,000 A Year

VySystemsNorth York, Canada
Full-time

Backend Engineer sought to develop Microservices and APIs using Java, Spring, and SQL. Show more

 • Promoted

Senior Java Engineer

CognizantToronto, ON, CA
Full-time

We are seeking a highly skilled.This role is deeply technical and requires someone who is comfortable spending.The ideal candidate has strong experience with.As a Senior Java Engineer, you will des... Show more

 • Promoted

Senior Software Engineer - Java & Data Platforms

AkkodisToronto, ON, CA
Full-time

Senior Software Engineer - Java & Data Platforms.Are you a Software Engineer who thrives on solving complex data challenges? We’re looking for a.Databricks, Spark, and Delta Lake.Make key architect... Show more

 • Promoted

Senior Java Engineer - Banking Tech, Spring Boot, Hybrid (Toronto)

MSZ SystemsToronto, ON, CA
Full-time

A software development firm in Toronto is seeking a Senior Java Software Engineer responsible for designing and maintaining high-performance applications using Java and Spring Boot.Candidates shoul... Show more

 • Promoted

Senior Backend Engineer, Analytics

Movable InkToronto, Ontario, Canada
Full-time

Movable Ink scales content personalization for marketers through data-activated content generation and AI decisioning.The world’s most innovative brands rely on Movable Ink to maximize revenue, sim... Show more

 • Promoted

Senior Java & Mobile Solutions Engineer

YDC ProToronto, Ontario, Canada
Full-time

A leading tech company in Toronto is looking for a skilled developer with over 10 years of experience in JEE and JAVA technologies, and 5 years in mobile solutions for both iOS and Android platform... Show more

 • Promoted

Senior Backend Engineer

Venn Software Inc.toronto, on, Canada
Full-time

Venn is the fastest-growing B2B fintech in Canada.We're on a mission to transform business banking for Canadian entrepreneurs and are looking to hire A-players interested in disrupting traditional ... Show more

 • Promoted

Senior Backend Engineer: Search Growth & Personalization - C$173,000 - C$192,000 A Year

Ride-sharing platformNorth York, Canada
Full-time

Seeking a Senior Backend Engineer to enhance search experience for a ride-sharing platform, focusing on growth and personalization features using Go or Java. Show more

 • Promoted

Senior Backend Engineer - C$150,000 - C$220,000 A Year

TalentTank Recruiting Inc.Toronto County, Canada
Full-time

Design and implement backend systems and APIs for AI-powered workflows.Build integrations, optimize performance, and work with various teams. Show more

 • Promoted

Senior Java Gen AI Engineer - Azure Hybrid

Compunnel Inc.Toronto, ON, CA
Full-time

An innovative company is seeking a Senior Java Gen AI Developer to join their dynamic team in Toronto.This role offers the opportunity to work on cutting-edge Gen AI products utilizing Azure's powe... Show more

 • Promoted

Senior Backend Engineer

NimbleRxToronto, ON, CA
Full-time

We are starting by building the largest, most loved pharmacy business in the world.We are a fast-growing, technology-first startup driven by perfecting the patient and pharmacist experience.Nimble ... Show more

 • Promoted

Senior Java Engineer — Backend (Kafka, Spring) Hybrid - C$70,000 - C$110,000 A Year

A leading technology companyNorth York, Canada
Full-time

Seeking a Senior Java Engineer for backend development using Java and Spring.Responsibilities include building Kafka services, optimizing performance, and ensuring code quality with automated testi... Show more