Data architect Jobs in Toronto, ON

Why you’ll love Softchoice:

At Softchoice, a World Wide Technology (WWT) company, we work together to make a new world happen. As an IT solutions provider serving U.S. commercial and SMB organizations, as well as the entire Canadian market, we help organizations turn ambition into real‑world outcomes. We do this through the delivery of secure cloud, AI, software and digital workplace solutions that enable agility, innovation and growth.

With a highly engaged, high-performing team, we are certified as a Great Place to Work® in both Canada and the United States, and have been recognized as a Best Workplace in Canada for more than 20 years. We stand proudly for our people and their success through career development and advancement, and continuously strive to do what’s good for our people and communities.

As part of WWT, we connect customers to the global scale, advanced innovation, world-class partnerships, and deep expertise of a leader in AI and digital transformation. This includes access to WWT’s Advanced Technology Center (ATC), a collaborative ecosystem featuring state-of-the-art hardware and software that enables customers and partners to conceptualize, test, and validate innovative solutions before deploying them at scale.

The Impact You'll Have:

We are seeking a Senior Technical Solutions Architect — AI to serve as a hands-on, platform-agnostic technical architect for our strategic AI engagements. This person sits at the intersection of customer strategy, applied AI engineering, and modern software delivery. They translate ambiguous business problems into working prototypes, scalable reference architectures, and production-grade solutions across public-cloud hyperscaler AI platforms and sovereign (on-premise / private) AI environments.

The ideal candidate is equally comfortable whiteboarding an agentic architecture with a CIO, writing the proof-of-concept code that proves it works, and guiding a client engineering team through the secure path to production. They are vendor-fluent but vendor-neutral — recommending the right tool for the workload, the data, the risk profile, and the budget.

What You'll Do:

Solutioning & Architecture

• Architect sovereign / on-premise AI solutions using stacks such as NVIDIA AI Enterprise (NIM, NeMo, Blueprints), Dell AI Factory, HPE Private Cloud AI, Red Hat OpenShift AI, Run:ai, and open-source model serving (vLLM, TGI, Ollama) — for clients with data residency, regulatory, IP, or air-gapped requirements.
• Design end-to-end AI solutions spanning Generative AI (RAG, CAG, GraphRAG, fine-tuning, model distillation) and agentic AI (tool-using agents, multi-agent orchestration, MCP-based integrations).
• Understanding of hybrid architecture across all major hyperscaler AI stacks — AWS (Bedrock, SageMaker, Q), Microsoft Azure (Azure AI Foundry, Azure OpenAI), and Google Cloud (Vertex AI, Gemini)
• Develop reusable reference architectures, decision frameworks, and trade-off analyses (cost, latency, accuracy, governance, sovereignty) that scale across the practice.

Client Engagement & Enablement

• Serve as the senior technical voice in client conversations — from executive briefings through deep technical design sessions.
• Partner with sales, delivery, and practice leadership to scope statements of work, estimate effort, and de-risk delivery.
• Mentor architects, engineers, and consultants across the broader AI practice; raise the technical bar through code reviews, internal enablement, and reusable assets.
• Stay ahead of the field — evaluate emerging models, frameworks, and protocols (e.g., MCP, A2A, ACP, new agent frameworks, new sovereign AI stacks) and bring well-reasoned points of view back to the practice.

What You'll Bring To The Table:

• 8+ years of progressive experience in software engineering, solutions / Enterprise architecture, or applied AI/ML, with at least 2+ years in a hands-on Generative AI or agentic AI role.
• Professional fluency in French and English, written and spoken (required) — able to lead client workshops, executive presentations, and technical documentation in both languages.
• Experience designing sovereign / on-premise AI solutions, including private model serving (NVIDIA NIM / NeMo, vLLM, TGI, Ollama), enterprise AI platforms (NVIDIA AI Enterprise, Red Hat OpenShift AI, Dell AI Factory, HPE Private Cloud AI, Run:ai), and on-premise vector / graph stores.
• Solid understanding of the infrastructure behind on-premise AI: GPU architecture and capacity planning, inference optimization (quantization, batching, KV-cache management), high-performance networking and storage, and Kubernetes-based GPU scheduling.
• Strong understanding of data sovereignty requirements and controls — data residency, privacy regulation (e.g., PIPEDA, Quebec Law 25, GDPR), air-gapped and disconnected deployments — and the ability to articulate trade-offs between sovereign, hybrid, and public-cloud AI architectures.
• Deep knowledge with at least one of the three major hyperscaler AI platforms (AWS, Azure, GCP) and a working understanding of the second and third.
• Production experience designing and shipping RAG and/or agentic systems, including practical familiarity with chunking strategies, embedding model selection, retrieval evaluation, and orchestration patterns.
• Working knowledge of MCP (Model Context Protocol) and modern agent-tool integration patterns; ability to design MCP servers and clients, and to reason about when MCP is the right abstraction versus alternatives.
• Strong understanding of CAG (Cache-Augmented Generation), RAG variants (naive, hybrid, GraphRAG, agentic RAG), and the trade-offs between each.
• Experience integrating with enterprise systems: REST/GraphQL APIs, event streams (Kafka, EventBridge), identity (OIDC, SAML, OAuth2), and enterprise data platforms (Snowflake, Databricks, Fabric, BigQuery).
• Excellent written and verbal communication; able to move fluidly between executive narrative and engineering whiteboard.

Education

Bachelor's degree in Computer Science, Engineering, Mathematics, or a related technical field, or equivalent demonstrable experience. Advanced degree is welcomed but not required.

Location & Travel

Remote-friendly with periodic travel to client sites and internal events (estimated 0–15%).

Compensation:

A reasonable estimate of the current base pay range for this position is $123,760 to $154,700 annually + 30% target incentives.

Actual salary will be based on a variety of factors, including location, experience, skill set, education, and related certification. The range for this position in other geographic locations may differ.

Softchoice offers a comprehensive and competitive benefit plan to all full-time employees, which includes:

• Health and Wellbeing: Medical and Dental Care, Employee & Family Assistance Program
• Financial Benefits: RRSP/DPSP Retirement Savings Plan with Company Matching, Life and Disability Insurance
• Paid Time Off: Vacation and Sick Leave, Holidays, Parental Leave, Volunteer Days, Bereavement Leave
• Additional Perks: Employee Discount Program

Not sure if you qualify? Think about applying anyway:

We understand that not everyone brings 100% of the skills and experience for the role.

At Softchoice, we offer opportunities to a diverse group including those with a variety of workplace experiences and backgrounds. Whether you are new to corporate tech, returning to work after a gap in employment, or looking to transition and take the next step in your career, we are excited to learn more about you and encourage you to apply.

Why You’ll Love Working Here:

• The People: You’ll thrive in our collaborative environment, surrounded by incredible colleagues who foster support and innovation, driving our collective success
• High-Performing Culture: At Softchoice, we are dedicated to achieving our goals and committed to success for our customers and each other
• Flexibility: Plan your workdays in a way that suits you best
• Award-Winning Workplace: Proudly recognized as a Great Place to Work for 21 consecutive years
• Inclusive Culture: We are committed to a company culture where every team member can be their authentic self
• Competitive Benefits: Benefit from competitive perks that start on day one

Inclusion & Equal opportunity employment:

We are an equal opportunity employer committed to diversity, inclusion & belonging. People seeking employment at Softchoice are considered without regard to any protected category including but not limited to, race, color, religion, national origin, age, sex, marital status, ancestry, disability, veteran status, gender identity, or sexual orientation.

Require accommodation? We are ready to help:

We are proud to provide interview & employment accommodation during the recruitment and hiring process. If you require any accommodation to apply or interview for a position, please reach out directly to . We are committed to working with you to best meet your needs.

Our commitment to your experience:

We are committed to the safety of all applicants and team members. With that in mind, we have implemented digital interviewing for everyone. We understand that you may need to interview with distractions around you (such as children or furry friends) and we will be doing the same.

Before you start with us, we will conduct a criminal record check, verify your education, and check your references.

When you join Softchoice, we will onboard you remotely. Don't worry. It's quick, simple and you'll be connected with your new team in no time.

Job Requisition ID: 7787

EoE/M/F/Vet/Disability

#LI-MM5