Talent.com
Senior Databricks Data Engineer
Senior Databricks Data EngineerCGI • Halifax, Nova Scotia, Canada
Senior Databricks Data Engineer

Senior Databricks Data Engineer

CGI • Halifax, Nova Scotia, Canada
6 days ago
Job type
  • Full-time
Job description

Position Description :

This is an exciting time for CGI and we want you to be part of it. We are Canadas largest independent information technology services firm and were still growing! Were expanding in Atlantic Canada and we need your skills enthusiasm and dedication as part of our team.

Your future duties and responsibilities :

Database Management

  • . Data Publishing : Enable data distribution through outbound streams queues and APIs.
  • . API Integration : Implement API mutations to facilitate data updates from external systems.
  • . Replication Management : Build and oversee replication stores to support data consistency and availability.

Software engineering

  • . Software Development Practices : Apply agile development methodologies version control (Git) CI / CD and automate testing to deliver reliable maintainable data solutions.
  • . Cloud and Infrastructure : Engineer and deploy cloud-native data solutions using platforms such as Azure AWS or GCP; optimize data pipelines for scalability cost efficiency and performance
  • Required qualifications to be successful in this role :

  • . More than 10 years of experience in data management and data engineering space.
  • . Experience with ETL
  • . Databricks
  • . Lakebridge DBX tool
  • . Experience with Azure services such as (ACI ARM Azure Monitor Log Analytics Azure Functions)
  • . Experience in pipeline development data publishing
  • . Strong SQL expertise Oracle Postgres
  • . Strong experience in data migration strategy planning and implementation
  • . Experienced in Docker Kubernetes
  • . Excellent customer and stakeholder management skills
  • . Strong analytical skills
  • . Experience in CI / CD
  • Nice to have

  • . Hands on experience in event-driven architecture using Apache Kafka or GCP Pub / Sub
  • . Experienced in microservices architecture cloud platforms (GCP) and observability tools (e.g. Google Cloud Monitoring)
  • CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level geographic market experience and training and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $70000 $135000. This role is an existing vacancy.

    #LI-OA1

    Use of the term engineering in this job posting refers to the technical sense related to Information Technology (IT) and does not imply that the individual practices engineering or possesses the requisite license as prescribed by the applicable provincial or territorial engineering regulator. We are seeking individuals with expertise in IT engineering-related functions but licensure from an engineering regulator is not a prerequisite for this position. Engineering is a regulated profession in Canada which is restricted in terms of use of titles and designation.

    Skills : ETL

    Kubernetes

  • Data Engineering
  • What you can expect from us :

    Together as owners lets turn meaningful insights into action.

    Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

    You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

    Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

    Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

    At CGI we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer being able to perform your best during the recruitment process is important to us. If you require an accommodation please inform your recruiter.

    To learn more about accessibility at CGI contact us via email. Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.

    Come join our teamone of the largest IT and business consulting services firms in the world.

    Required Experience :

    Senior IC

    Key Skills

    Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

    Employment Type : Full-Time

    Experience : years

    Vacancy : 1

    Monthly Salary Salary : 70000 - 135000

    Create a job alert for this search

    Senior Data Engineer • Halifax, Nova Scotia, Canada

    Similar jobs
    Project Engineer - Fisheries (Mid-Level)

    Project Engineer - Fisheries (Mid-Level)

    Kleinschmidt Group • Halifax, NS, Canada
    Full-time
    If you are interested in using your engineering background to work on important projects that make a real difference, then this may be the job for you. An ideal candidate would enjoy the challenge o...Show more
    Last updated: 30+ days ago • Promoted
    Systems Engineer

    Systems Engineer

    GeoSpectrum Technologies, Inc • Dartmouth, NS, Canada
    Full-time
    Are you a driven and innovative Systems Engineer with defence or aerospace experience and a passion for seeing the big picture? Do you thrive in dynamic environments and take pride in owning projec...Show more
    Last updated: 1 day ago • Promoted
    Bioprocess Engineer

    Bioprocess Engineer

    DeNova • Dartmouth, NS, Canada
    Full-time
    Salary : $70,000 - $85,000 per year.DeNova is a Canadian biotechnology company developing sustainable food solutions through microbial fermentation. DeNova operates a research and development pilot f...Show more
    Last updated: 29 days ago • Promoted
    2 - Senior Data Engineer

    2 - Senior Data Engineer

    Targeted Talent • Halifax, NS, Canada
    Permanent
    We are looking for an experienced.This is a permanent position that is remote to start with later relocation to.Our client is a global enterprise company with a product that you've likely used....Show more
    Last updated: 30+ days ago • Promoted
    Field Specialist

    Field Specialist

    Clutch Technologies Inc. • Halifax, NS, Canada
    Full-time +1
    Ready to join one of Canada's fastest-growing companies (Deloitte's Enterprise Leaders List 2024 – Rank #3) as a.Competitive Pay & Stable Schedule. Competitive wages with flexible ...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Galent • dartmouth, ns, ca
    Full-time
    Key Role and Responsibilities : .Design, develop, and maintain custom AEM components, templates, and workflows across Sites, Assets, and Forms. Have a working understanding of the AEM authoring interf...Show more
    Last updated: 8 hours ago • Promoted • New!
    Workday Integration Lead

    Workday Integration Lead

    Quality IT Resourcing • halifax, ns, ca
    Full-time
    Lead the design, development, and implementation of integration solutions between Workday and internal / external systems, promoting data accuracy, security, and seamless process flows.Collaborate wi...Show more
    Last updated: 2 days ago • Promoted
    Data Annotator

    Data Annotator

    Morpheus Talent Solutions • dartmouth, ns, ca
    Full-time +1
    Flexible, part-time or full-time hours.Our client, a fast-growing company working at the intersection of gaming and AI, is seeking. This is an excellent opportunity for candidates with strong attent...Show more
    Last updated: 8 hours ago • Promoted • New!
    Senior Associate, Genesis, Portfolio Operations (Halifax)

    Senior Associate, Genesis, Portfolio Operations (Halifax)

    MUFG Investor Services • Halifax, NS, Canada
    Full-time
    MUFG Investor Services is a trusted partner to many of the world’s largest public and private funds, providing asset servicing and operational solutions built for alternatives.With over $1 tr...Show more
    Last updated: 30+ days ago • Promoted
    Tech Lead - Innovative Software Development Team

    Tech Lead - Innovative Software Development Team

    Rimot.io Inc. • Halifax, NS, Canada
    Full-time +1
    Tech Lead at BlueGrid Shape the Future of Marine Electrification.Location : Halifax, Nova Scotia (Hybrid Work-From-Home / Company Office). BlueGrid is pioneering the intelligence layer for maritime e...Show more
    Last updated: 28 days ago • Promoted
    Operations Supervisor

    Operations Supervisor

    Inland Technologies Canada Incorporated • B2T 1K3, NS, Canada
    Full-time +1
    Our employees receive the following, based on eligibility requirements : .Employee relocation assistance.Insurance - health, dental, life, AD&D and LTD. Pension plan with employer match.Competitiv...Show more
    Last updated: 5 days ago • Promoted
    Accounts development specialist

    Accounts development specialist

    NAPA Auto Parts • Elmsdale, NS, Canada
    Full-time
    Be part of a community of authentic, proud and trusted people.At NAPA, we are driving the future of the auto parts industry with unmatched service and innovative solutions.Our passionate sales team...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Global Spatial Technology Solutions • Dartmouth, NS, Canada
    Full-time
    GSTS is a leading Maritime AI company specializing in advanced analytics, risk management, and operational optimization solutions for the global maritime industry. Our mission is to enable safer, sm...Show more
    Last updated: 30+ days ago • Promoted
    Account Manager - Halifax

    Account Manager - Halifax

    Doka Group • Mount Uniacke, NS, Canada
    Full-time
    Doka’s expertise in formwork technology is unparalleled in the industry and we are proud of the difference we make globally! “It’s not just formwork – it’s DOKA&...Show more
    Last updated: 30+ days ago • Promoted
    Python Developer

    Python Developer

    NLB Services • halifax, ns, ca
    Full-time
    Strong programming experience in Python (required); JavaScript / TypeScript a plus.AI workflows using frameworks such as LangChain, LangGraph, AutoGen, CrewAI, or Semantic Kernel.ReAct, Plan-and-Exec...Show more
    Last updated: 1 day ago • Promoted
    Senior Analytics Engineer

    Senior Analytics Engineer

    TekRek • halifax, ns, ca
    Full-time
    TekRek has partnered with a fast growing firm specializing in AI enablement and data optimization.Our client works with some of the top tier technology firms in Silcom Valley.With rapid growth and ...Show more
    Last updated: 2 days ago • Promoted
    Algebra Private Tutoring Jobs Duncans Cove

    Algebra Private Tutoring Jobs Duncans Cove

    Superprof • Duncans Cove, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Infrastructure Engineer with Kubernetes

    Sr. Infrastructure Engineer with Kubernetes

    Confidential • dartmouth, ns, ca
    Full-time
    The role seeks a highly experienced Infrastructure Specialist to spearhead the design, deployment, and operational excellence of a modern cloud-native infrastructure. The ideal candidate must posses...Show more
    Last updated: 8 days ago • Promoted