Talent.com
Senior Databricks Data Engineer
Senior Databricks Data EngineerCGI • Halifax, Nova Scotia, Canada
Senior Databricks Data Engineer

Senior Databricks Data Engineer

CGI • Halifax, Nova Scotia, Canada
6 days ago
Job type
  • Full-time
Job description

Position Description :

This is an exciting time for CGI and we want you to be part of it. We are Canadas largest independent information technology services firm and were still growing! Were expanding in Atlantic Canada and we need your skills enthusiasm and dedication as part of our team.

Your future duties and responsibilities :

Database Management

  • . Data Publishing : Enable data distribution through outbound streams queues and APIs.
  • . API Integration : Implement API mutations to facilitate data updates from external systems.
  • . Replication Management : Build and oversee replication stores to support data consistency and availability.

Software engineering

  • . Software Development Practices : Apply agile development methodologies version control (Git) CI / CD and automate testing to deliver reliable maintainable data solutions.
  • . Cloud and Infrastructure : Engineer and deploy cloud-native data solutions using platforms such as Azure AWS or GCP; optimize data pipelines for scalability cost efficiency and performance
  • Required qualifications to be successful in this role :

  • . More than 10 years of experience in data management and data engineering space.
  • . Experience with ETL
  • . Databricks
  • . Lakebridge DBX tool
  • . Experience with Azure services such as (ACI ARM Azure Monitor Log Analytics Azure Functions)
  • . Experience in pipeline development data publishing
  • . Strong SQL expertise Oracle Postgres
  • . Strong experience in data migration strategy planning and implementation
  • . Experienced in Docker Kubernetes
  • . Excellent customer and stakeholder management skills
  • . Strong analytical skills
  • . Experience in CI / CD
  • Nice to have

  • . Hands on experience in event-driven architecture using Apache Kafka or GCP Pub / Sub
  • . Experienced in microservices architecture cloud platforms (GCP) and observability tools (e.g. Google Cloud Monitoring)
  • CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level geographic market experience and training and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $70000 $135000. This role is an existing vacancy.

    #LI-OA1

    Use of the term engineering in this job posting refers to the technical sense related to Information Technology (IT) and does not imply that the individual practices engineering or possesses the requisite license as prescribed by the applicable provincial or territorial engineering regulator. We are seeking individuals with expertise in IT engineering-related functions but licensure from an engineering regulator is not a prerequisite for this position. Engineering is a regulated profession in Canada which is restricted in terms of use of titles and designation.

    Skills : ETL

    Kubernetes

  • Data Engineering
  • What you can expect from us :

    Together as owners lets turn meaningful insights into action.

    Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

    You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

    Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

    Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

    At CGI we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer being able to perform your best during the recruitment process is important to us. If you require an accommodation please inform your recruiter.

    To learn more about accessibility at CGI contact us via email. Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.

    Come join our teamone of the largest IT and business consulting services firms in the world.

    Required Experience :

    Senior IC

    Key Skills

    Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

    Employment Type : Full-Time

    Experience : years

    Vacancy : 1

    Monthly Salary Salary : 70000 - 135000

    Create a job alert for this search

    Senior Data Engineer • Halifax, Nova Scotia, Canada

    Similar jobs
    Project Engineer - Fisheries (Mid-Level)

    Project Engineer - Fisheries (Mid-Level)

    Kleinschmidt Group • Halifax, NS, Canada
    Full-time
    If you are interested in using your engineering background to work on important projects that make a real difference, then this may be the job for you. An ideal candidate would enjoy the challenge o...Show more
    Last updated: 30+ days ago • Promoted
    Systems Engineer

    Systems Engineer

    GeoSpectrum Technologies, Inc • Dartmouth, NS, Canada
    Full-time
    Are you a driven and innovative Systems Engineer with defence or aerospace experience and a passion for seeing the big picture? Do you thrive in dynamic environments and take pride in owning projec...Show more
    Last updated: 15 hours ago • Promoted • New!
    Bioprocess Engineer

    Bioprocess Engineer

    DeNova • Dartmouth, NS, Canada
    Full-time
    Salary : $70,000 - $85,000 per year.DeNova is a Canadian biotechnology company developing sustainable food solutions through microbial fermentation. DeNova operates a research and development pilot f...Show more
    Last updated: 28 days ago • Promoted
    2 - Senior Data Engineer

    2 - Senior Data Engineer

    Targeted Talent • Halifax, NS, Canada
    Permanent
    We are looking for an experienced.This is a permanent position that is remote to start with later relocation to.Our client is a global enterprise company with a product that you've likely used....Show more
    Last updated: 30+ days ago • Promoted
    Field Specialist

    Field Specialist

    Clutch Technologies Inc. • Halifax, NS, Canada
    Full-time +1
    Ready to join one of Canada's fastest-growing companies (Deloitte's Enterprise Leaders List 2024 – Rank #3) as a.Competitive Pay & Stable Schedule. Competitive wages with flexible ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Associate, Genesis, Portfolio Operations (Halifax)

    Senior Associate, Genesis, Portfolio Operations (Halifax)

    MUFG Investor Services • Halifax, NS, Canada
    Full-time
    MUFG Investor Services is a trusted partner to many of the world’s largest public and private funds, providing asset servicing and operational solutions built for alternatives.With over $1 tr...Show more
    Last updated: 30+ days ago • Promoted
    Tech Lead - Innovative Software Development Team

    Tech Lead - Innovative Software Development Team

    Rimot.io Inc. • Halifax, NS, Canada
    Full-time +1
    Tech Lead at BlueGrid Shape the Future of Marine Electrification.Location : Halifax, Nova Scotia (Hybrid Work-From-Home / Company Office). BlueGrid is pioneering the intelligence layer for maritime e...Show more
    Last updated: 28 days ago • Promoted
    Operations Supervisor

    Operations Supervisor

    Inland Technologies Canada Incorporated • B2T 1K3, NS, Canada
    Full-time +1
    Our employees receive the following, based on eligibility requirements : .Employee relocation assistance.Insurance - health, dental, life, AD&D and LTD. Pension plan with employer match.Competitiv...Show more
    Last updated: 4 days ago • Promoted
    FinOps Data Analyst AWADC5715582 - Compunnel Inc.

    FinOps Data Analyst AWADC5715582 - Compunnel Inc.

    Compunnel Inc. • dartmouth, ns, ca
    Full-time
    Location : Monreal, QC (Hybrid Role).Drive adoption of Cloud FinOps capabilities and best practice for cloud cost management within the organization. Monitor, analyze, and report on cloud spend acros...Show more
    Last updated: 13 hours ago • Promoted • New!
    Accounts development specialist

    Accounts development specialist

    NAPA Auto Parts • Elmsdale, NS, Canada
    Full-time
    Be part of a community of authentic, proud and trusted people.At NAPA, we are driving the future of the auto parts industry with unmatched service and innovative solutions.Our passionate sales team...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Global Spatial Technology Solutions • Dartmouth, NS, Canada
    Full-time
    GSTS is a leading Maritime AI company specializing in advanced analytics, risk management, and operational optimization solutions for the global maritime industry. Our mission is to enable safer, sm...Show more
    Last updated: 30+ days ago • Promoted
    Data Analyst - Dexian

    Data Analyst - Dexian

    Dexian • dartmouth, ns, ca
    Full-time
    Data Governance Analyst - Rates Trading.Location : Mississauga, ON (Hybrid).Support the execution of Data Consent Order remediation programmes, contributing to delivery in line with regulatory commi...Show more
    Last updated: 17 hours ago • Promoted • New!
    Account Manager - Halifax

    Account Manager - Halifax

    Doka Group • Mount Uniacke, NS, Canada
    Full-time
    Doka’s expertise in formwork technology is unparalleled in the industry and we are proud of the difference we make globally! “It’s not just formwork – it’s DOKA&...Show more
    Last updated: 30+ days ago • Promoted
    Senior Analytics Engineer

    Senior Analytics Engineer

    TekRek • halifax, ns, ca
    Full-time
    TekRek has partnered with a fast growing firm specializing in AI enablement and data optimization.Our client works with some of the top tier technology firms in Silcom Valley.With rapid growth and ...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Flexstaf I.T. Inc. • dartmouth, ns, ca
    Permanent
    We’re Hiring : Data Engineer (Permanent | Hybrid – Ontario).We are currently seeking a Data Engineer to join our growing data and analytics team. This role is ideal for a technically strong, curious,...Show more
    Last updated: 13 hours ago • Promoted • New!
    Algebra Private Tutoring Jobs Duncans Cove

    Algebra Private Tutoring Jobs Duncans Cove

    Superprof • Duncans Cove, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Python Developer - Hays

    Python Developer - Hays

    Hays • dartmouth, ns, ca
    Full-time
    Data Engineer / Python Developer.AI chatbot in the healthcare domain.This is not a traditional BI or ETL role; you will not be building dashboards or moving data for analytics.Instead, you will arc...Show more
    Last updated: 17 hours ago • Promoted • New!
    Machine Learning Engineer - halifax

    Machine Learning Engineer - halifax

    Iris Software Inc. • halifax, ns, ca
    Full-time
    Iris's direct client, one of the leading Fortune 500 Company, is looking to hire.Please take a look at the below mentioned job description and let me know if you would be interested.The following j...Show more
    Last updated: 1 day ago • Promoted