Talent.com
Databricks Engineering Consultant
Databricks Engineering ConsultantCGI • Edmonton, AB, Canada
Databricks Engineering Consultant

Databricks Engineering Consultant

CGI • Edmonton, AB, Canada
Il y a 16 jours
Type de contrat
  • Temps plein
Description de poste

Databricks Engineering Consultant

Position Description

CGI is the world's 5th largest independent IT and business consulting services firm, operating across 40 countries and delivering more than 100 IP-based solutions to clients in Financial Services, Government, Healthcare, Manufacturing, Utilities, Oil & Gas, and more. We are recognized globally for our on-time, on-budget delivery and our role as a trusted advisor to leading organizations.

As organizations accelerate their data and analytics modernization, CGI is expanding its Data & AI consulting practice. We are seeking a Databricks Engineering Consultant with strong expertise in Databricks platform administration, Spark performance optimization, and secure, reliable operations.

Join our team and help operate and scale enterprise-grade analytics platforms that deliver reliable, high-performance data solutions.

Your future duties and responsibilities

As a Databricks Engineering Consultant, you will be responsible for the configuration, management, and operational excellence of Databricks environments. This includes managing workspaces, clusters, compute pools, libraries, and security configurations, as well as optimizing Apache Spark performance to ensure efficient and cost-effective data processing.

You will work closely with Data Architects, Cloud Architects, and Security teams to ensure Databricks platforms are secure, performant, scalable, and compliant with enterprise operational standards.

Key Responsibilities

Databricks Platform Administration

  • . Configure and manage Databricks workspaces, including environments for development, testing, and production.
  • . Provision, configure, and optimize clusters and compute pools to balance performance, reliability, and cost.
  • . Manage Databricks runtime versions, cluster policies, and job configurations.
  • . Administer libraries and dependencies, ensuring consistent and reliable runtime environments.

Spark Performance & Optimization

  • . Monitor and tune Apache Spark workloads, including memory management, partitioning, caching, and execution plans.
  • . Identify and remediate performance bottlenecks in batch and streaming workloads.
  • . Collaborate with data engineering teams to optimize Spark code and pipeline execution.
  • . Implement best practices for cost optimization and resource utilization.
  • Security, Governance & Operational Controls

  • . Enforce workspace security policies, including access controls, permissions, and cluster policies.
  • . Support integration with enterprise identity providers and role-based access models.
  • . Implement operational standards for logging, monitoring, and alerting.
  • . Ensure Databricks environments comply with enterprise security, privacy, and operational governance requirements.
  • Cloud & Platform Integration

  • . Integrate Databricks with cloud-native services such as Azure Data Lake Storage, Azure Key Vault, and networking components.
  • . Support secure connectivity patterns and secret management.
  • . Collaborate with Cloud Architects on infrastructure design and optimization.
  • Delivery & Collaboration

  • . Partner with Data Architects and Data Engineers to support reliable deployment and execution of data pipelines.
  • . Participate in platform design discussions, providing operational and performance perspectives.
  • . Contribute to documentation, runbooks, and operational standards.
  • . Provide guidance and mentorship on Databricks operational best practices
  • Required qualifications to be successful in this role

    Must-Have Technical Experience

  • . 5–10+ years of experience in data engineering, platform engineering, or cloud data operations, including : Databricks workspace and cluster administration Apache Spark performance tuning Compute pools, jobs, and scheduling Library and dependency management
  • . Strong experience with Cloud platforms (Azure preferred).
  • . Hands-on experience with monitoring, troubleshooting, and operational support of data platforms.
  • . Solid understanding of security, access controls, and operational governance.
  • Industry Experience

  • . Experience supporting data platforms in enterprise or regulated environments, such as Energy, Utilities, Financial Services, or Government, is an asset.
  • Consulting & Collaboration Skills

  • . Ability to work effectively in client-facing environments.
  • . Strong communication skills to collaborate with architects, engineers, and stakeholders.
  • . Experience working in Agile delivery teams.
  • Additional Assets

  • . Experience with Delta Lake and Databricks Jobs.
  • . Familiarity with CI / CD and DataOps practices.
  • . Experience with monitoring and observability tools.
  • . Knowledge of cost management and optimization in cloud environments.
  • Education & Certifications

  • . Bachelor's degree in Computer Science, Engineering, Data Science, or a related field.
  • . Databricks certifications (e.g., Databricks Data Engineer, Databricks Platform Administrator) are a strong asset.
  • . Cloud certifications (Azure) are an asset.
  • "CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes various factors including but not limited to skill set level, geographic market, experience and training, and licenses and certifications. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $85,000 - $150,000."

    Why CGI?

    At CGI, you will play a critical role in ensuring the reliability and performance of enterprise analytics platforms for some of Canada's most complex organizations. You will work in a collaborative, ownership-driven culture while building deep expertise in modern data platforms.

    Learn more at www.cgi.com.

    #LI-AP1

    Together, as owners, let’s turn meaningful insights into action.

    Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

    You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

    Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

    You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

    At CGI, we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer, being able to perform your best during the recruitment process is important to us. If you require an accommodation, please inform your recruiter.

    To learn more about accessibility at CGI, contact us via email . Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.

    Come join our team—one of the largest IT and business consulting services firms in the world.

    Créer une alerte emploi pour cette recherche

    Databricks Engineering Consultant • Edmonton, AB, Canada

    Offres similaires
    Alternatives To Cash Jobs - Deliver with Uber

    Alternatives To Cash Jobs - Deliver with Uber

    Uber eats • Beaumont, AB, CA
    Temps plein +2
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Voir plus
    Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
    Independent Contractor - Shopper and Delivery Driver

    Independent Contractor - Shopper and Delivery Driver

    Instacart Shoppers • beaumont, AB, CA
    Temps partiel
    Start earning money fast and be your own boss.Instacart is a leading retail enablement platform that works with grocers and retailers to transform how people shop. Instacart’s platform helps people ...Voir plus
    Dernière mise à jour : il y a 1 jour • Offre sponsorisée
    Data & AI Consultant I and Developer

    Data & AI Consultant I and Developer

    Insight Public Sector • Edmonton
    Temps plein
    Insight does not accept unsolicited resumes from recruiters or employment agencies.Unsolicited resumes will be treated as direct applications from the candidate, and recruiters or agencies who subm...Voir plus
    Dernière mise à jour : il y a 7 jours • Offre sponsorisée
    eats delivery work at your own pace

    eats delivery work at your own pace

    beBeeFlexibility • Beaumont, AB, AB, Canada
    Temps plein
    Deliver with Flexibility Make money your way, on your terms.Earning Opportunities Abound! With Uber Eats , you can ea...Voir plus
    Dernière mise à jour : il y a 10 heures • Offre sponsorisée • Nouvelle offre
    VMS Implementation Consultant - Contingent Workforce Solutions - SimplifyVMS

    VMS Implementation Consultant - Contingent Workforce Solutions - SimplifyVMS

    SimplifyVMS • edmonton, ab, ca
    Temps plein
    Vendor Management System (VMS) solutions.AI, automation, and advanced workforce analytics.Global Head of Marketing & Demand Generation. SimplifyVMS as a market leader in.SimplifyVMS is seeking a dyn...Voir plus
    Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
    Enterprise Data Architect : Shape Scalable Data Foundations

    Enterprise Data Architect : Shape Scalable Data Foundations

    Aplin • Edmonton
    Temps plein
    A leading recruitment firm in Canada is seeking a Data Architect to shape the data foundation for various applications and analytics. The successful candidate will translate business objectives into...Voir plus
    Dernière mise à jour : il y a 2 jours • Offre sponsorisée
    SAP SuccessFactors Consulting Manager - Technical Integrations Lead

    SAP SuccessFactors Consulting Manager - Technical Integrations Lead

    Quality IT Resourcing • edmonton, AB, ca
    Temps plein
    SAP SuccessFactors Consulting Manager - Technical Integrations Lead Were seeking a dynamic and technically skilled SAP Su...Voir plus
    Dernière mise à jour : il y a 12 jours • Offre sponsorisée
    Databricks Engineering Consultant

    Databricks Engineering Consultant

    CGI • Edmonton
    Temps plein
    CGI is the world's 5th largest independent IT and business consulting services firm, operating across 40 countries and delivering more than 100 IP-based solutions to clients in Financial Services, ...Voir plus
    Dernière mise à jour : il y a 10 jours • Offre sponsorisée
    Data Centre Design & Planning Engineer — Impact & Growth

    Data Centre Design & Planning Engineer — Impact & Growth

    Qu Data Centres • Edmonton
    Temps plein
    A leading data centre firm is seeking an Intermediate Data Centre Design & Planning Engineer.This role involves supporting engineering, planning, and lifecycle management of data centre infrastruct...Voir plus
    Dernière mise à jour : il y a 19 jours • Offre sponsorisée
    VMS Implementation Consultant - Contingent Workforce Solutions - edmonton

    VMS Implementation Consultant - Contingent Workforce Solutions - edmonton

    SimplifyVMS • edmonton, ab, ca
    Temps plein
    Vendor Management System (VMS) solutions.AI, automation, and advanced workforce analytics.Global Head of Marketing & Demand Generation. SimplifyVMS as a market leader in.SimplifyVMS is seeking a dyn...Voir plus
    Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
    Data Engineering Manager : Azure & Fabric Platform Lead

    Data Engineering Manager : Azure & Fabric Platform Lead

    SNDL Inc. • Edmonton
    Temps plein
    A leading Canadian liquor and cannabis company is seeking a Data Engineering Manager to lead a team of data engineers at their Edmonton office. This role requires expertise in Azure and Microsoft Fa...Voir plus
    Dernière mise à jour : il y a 19 jours • Offre sponsorisée
    Solutions Engineer

    Solutions Engineer

    Meld • edmonton, AB, ca
    Temps plein
    About the Company Meld is a fast growing startup looking to add developer support for customers who use our API driven platform for managing their crypto related integra...Voir plus
    Dernière mise à jour : il y a 8 heures • Offre sponsorisée • Nouvelle offre
    Software Engineering Consultant - E-Solutions

    Software Engineering Consultant - E-Solutions

    E-Solutions • edmonton, ab, ca
    Temps plein
    ServiceNow Administrator – Mid / L2–L3.Location : Mississauga, On and Vancouver, BC.Owns configuration, platform stability, and enhancement support across multiple ServiceNow modules.Administer user...Voir plus
    Dernière mise à jour : il y a 21 jours • Offre sponsorisée
    Full Stack Engineer

    Full Stack Engineer

    Luxoft • edmonton, AB, ca
    Temps plein
    Project Description : Our Customer is one of the worlds largest investment management companies.Based in Southern California, our client manages close to $2 trillion in a...Voir plus
    Dernière mise à jour : il y a 8 heures • Offre sponsorisée • Nouvelle offre
    Solutions Consultant

    Solutions Consultant

    ExaCare AI • edmonton, ab, ca
    Temps plein
    We are a trailblazing health tech company on a mission to revolutionize the nursing home & post acute space.Our innovative AI software is transforming the admissions process and care delivery in th...Voir plus
    Dernière mise à jour : il y a 12 heures • Offre sponsorisée • Nouvelle offre
    Solutions Consultant - ExaCare AI

    Solutions Consultant - ExaCare AI

    ExaCare AI • edmonton, ab, ca
    Temps plein
    We are a trailblazing health tech company on a mission to revolutionize the nursing home & post acute space.Our innovative AI software is transforming the admissions process and care delivery in th...Voir plus
    Dernière mise à jour : il y a 12 heures • Offre sponsorisée • Nouvelle offre
    Software Engineering Consultant - edmonton

    Software Engineering Consultant - edmonton

    E-Solutions • edmonton, ab, ca
    Temps plein
    ServiceNow Administrator – Mid / L2–L3.Location : Mississauga, On and Vancouver, BC.Owns configuration, platform stability, and enhancement support across multiple ServiceNow modules.Administer user...Voir plus
    Dernière mise à jour : il y a 21 jours • Offre sponsorisée
    Looking For Jobs Near Me? - Deliver with Uber

    Looking For Jobs Near Me? - Deliver with Uber

    Uber eats • Beaumont, AB, CA
    Temps plein +2
    Delivering with Uber is an alternative to a part-time or full-time job and can get you earning cash quickly.Delivering with Uber allows you to earn quick cash while maintaining the flexibility your...Voir plus
    Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée