Talent.com
Azure Data Engineer - Pyspark
Azure Data Engineer - PysparkCapgemini • Town of Bridgewater, Lunenburg County, CA
Azure Data Engineer - Pyspark

Azure Data Engineer - Pyspark

Capgemini • Town of Bridgewater, Lunenburg County, CA
1 day ago
Job type
  • Full-time
Job description

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Job Location - Newark NJ (Day One Onsite - Hybrid - 3 days in a week)

Key Responsibilities

  • Design and implement batch and streaming data pipelines on Azure Databricks (PySpark); author Spark SQL for transformations and analytics.
  • Orchestrate workflows with Azure Data Factory and / or Synapse pipelines; integrate with Lake Storage.
  • Model and maintain lakehouse structures (e.g., Delta Lake), ensuring robust partitioning, schema evolution, and performance.
  • Implement data quality checks, observability, and SLAs across pipelines.
  • Optimize jobs for cost and performance (cluster sizing, caching, shuffle reduction, partition strategy).
  • Collaborate with architecture / platform teams on CI / CD (Azure DevOps), secrets management (Key Vault), and security (RBAC, PIM).
  • Contribute to governance and metadata practices; document lineage and technical design.
  • Support release cycles, incident triage, and production hardening; drive continuous improvements.

Required Skills

  • Hands on expertise in PySpark (DataFrames, Spark SQL, performance tuning) on Azure Databricks-this is the primary skill focus.
  • Strong SQL and data modeling for analytical workloads (star / snowflake, lakehouse patterns).
  • Proven delivery with Azure Data Factory / Synapse for pipeline orchestration and scheduling.
  • Solid knowledge of Azure storage (ADLS Gen2, partitions, file formats-Parquet / Delta).
  • Version control and CI / CD with Git / Azure DevOps; automated testing in data pipelines.
  • Experience operating pipelines in production (monitoring, alerting, reliability).
  • Nice to have (preferred)

  • Microsoft Fabric exposure is nice to have (not mandatory)
  • Data governance tools (e.g., Purview), Power BI integration, Delta Live Tables.
  • Python packaging best practices; basic PowerShell for automation.
  • Domain experience in financial services / asset management.
  • Life At Capgemini

    Capgemini Supports All Aspects Of Your Well‑being Throughout The Changing Stages Of Your Life And Career. For Eligible Employees, We Offer

  • Flexible work
  • Healthcare including dental, vision, mental health, and well‑being programs
  • Financial well‑being programs such as 401(k) and Employee Share Ownership Plan
  • Paid time off and paid holidays
  • Paid parental leave
  • Family building benefits like adoption assistance, surrogacy, and cryopreservation
  • Social well‑being benefits like subsidized back‑up child / elder care and tutoring
  • Mentoring, coaching and learning programs
  • Employee Resource Groups
  • Disaster Relief
  • Disclaimer

    Salary Transparency Capgemini discloses salary range information in compliance with state and local pay transparency obligations. The disclosed range represents the lowest to highest salary we, in good faith, believe we would pay for this role at the time of this posting, although we may ultimately pay more or less than the disclosed range, and the range may be modified in the future. The disclosed range takes into account the wide range of factors that are considered in making compensation decisions including, but not limited to, geographic location, relevant education, qualifications, certifications, experience, skills, seniority, performance, sales or revenue‑based metrics, and business or organizational needs. At Capgemini, it is not typical for an individual to be hired at or near the top of the range for their role. The base salary range for the tagged location is $110,841 to $145,000 yearly. This role may be eligible for other compensation including variable compensation, bonus, or commission. Full time regular employees are eligible for paid time off, medical / dental / vision insurance, 401(k), and any other benefits to eligible employees. Note : No amount of pay is considered to be wages or compensation until such amount is earned, vested, and determinable. The amount and availability of any bonus, commission, or any other form of compensation that are allocable to a particular employee remains in the Company’s sole discretion unless and until paid and may be modified at the Company’s sole discretion, consistent with the law. The base compensation range for this role in the posted location is $110,841 to $145,000. Capgemini provides compensation range information in accordance with applicable national, state, provincial, and local pay transparency laws. The base compensation range listed for this position reflects the minimum and maximum target compensation Capgemini, in good faith, believes it may pay for the role at the time of this posting. This range may be subject to change as permitted by law. The actual compensation offered to any candidate may fall outside of the posted range and will be determined based on multiple factors legally permitted in the applicable jurisdiction.

    Benefits

    Capgemini offers a comprehensive, non‑negotiable benefits package to all regular, full‑time employees.

  • Paid time off based on employee grade (A–F), defined by policy : Vacation : 12–25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
  • Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
  • Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
  • Life and disability insurance
  • Employee assistance programs
  • Other benefits as provided by local policy and eligibility
  • Important Notice

    Compensation (including bonuses, commissions, or other forms of incentive pay) is not considered earned, vested, or payable until it becomes due under the terms of applicable plans or agreements and is subject to Capgemini’s discretion, consistent with applicable laws. The Company reserves the right to amend or withdraw compensation programs at any time, within the limits of applicable legislation.

    Disclaimers

    Capgemini is an Equal Opportunity Employer encouraging inclusion in the workplace. Capgemini also participates in the Partnership Accreditation in Indigenous Relations (PAIR) program which supports meaningful engagement with Indigenous communities across Canada by promoting fairness, accessibility, inclusion and respect. We value the rich cultural heritage and contributions of Indigenous Peoples and actively work to create a welcoming and respectful environment. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity / expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law. This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and / or changing the way this job is performed, provided that such accommodation does not pose an undue hardship. Capgemini is committed to providing reasonable accommodation during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact. Please be aware that Capgemini may capture your image (video or screenshot) during the interview process and that image may be used for verification, including during the hiring and onboarding process.

    Click the following link for more information on your rights as an Applicant in the United States. http : / / www.capgemini.com / resources / equal-employment-opportunity-is-the-law

    Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55‑year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end‑to‑end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.

    #J-18808-Ljbffr

    Create a job alert for this search

    Azure Data Engineer Pyspark • Town of Bridgewater, Lunenburg County, CA

    Similar jobs
    Trigonometry Private Tutoring Jobs Hunts Point

    Trigonometry Private Tutoring Jobs Hunts Point

    Superprof • Hunts Point, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Writer / Journalist Internship Part-Time in Worldwide - Remote Worldwide

    Writer / Journalist Internship Part-Time in Worldwide - Remote Worldwide

    code4 • Bridgewater, Canada
    Remote
    Part-time +1
    Are you passionate about making a difference in the world? Look no further! The Borgen Project is an international organization that works at the political level to improve living conditions for pe...Show more
    Last updated: 1 day ago • Promoted
    Geometry Private Tutoring Jobs Hunts Point

    Geometry Private Tutoring Jobs Hunts Point

    Superprof • Hunts Point, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    English Private Tutoring Jobs Hunts Point

    English Private Tutoring Jobs Hunts Point

    Superprof • Hunts Point, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Writer / Journalist Internship Part-Time in Worldwide - Remote Worldwide

    Writer / Journalist Internship Part-Time in Worldwide - Remote Worldwide

    The Borgen Project • Bridgewater, Nova Scotia, Canada
    Remote
    Part-time +1
    Are you passionate about making a difference in the world? Look no further! The Borgen Project is an international organization that works at the political level to improve living conditions for pe...Show more
    Last updated: 1 day ago • Promoted
    Physics Private Tutoring Jobs Hunts Point

    Physics Private Tutoring Jobs Hunts Point

    Superprof • Hunts Point, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Geometry Private Tutoring Jobs Bridgewater

    Geometry Private Tutoring Jobs Bridgewater

    Superprof • Bridgewater, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Biology Private Tutoring Jobs Hunts Point

    Biology Private Tutoring Jobs Hunts Point

    Superprof • Hunts Point, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Pest Control Technician

    Pest Control Technician

    Rentokil Initial • Bridgewater, NS, Canada
    Full-time
    Route Based in : Lower Sackville, NS.Rentokil Terminix is the world's largest pest control company, offering the broadest, most advanced range of pest control solutions and services in the indus...Show more
    Last updated: 7 days ago • Promoted
    Algebra Private Tutoring Jobs Hunts Point

    Algebra Private Tutoring Jobs Hunts Point

    Superprof • Hunts Point, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted