We are seeking an Intermediate Data Engineer to join a high‑impact Data Integrity team responsible for delivering reliable real‑time and batch data that powers key performance metrics across the organization.
This role involves end‑to‑end project execution within Agile, 2‑week sprints , including onboarding diverse data sources, defining transformation requirements, and collaborating with quality teams to ensure data accuracy. The engineer will be hands‑on with ETL development , data validation , and unit testing , while contributing to both new data initiatives and the optimization of existing pipelines .
The ideal candidate is technically capable, collaborative, and motivated to learn and grow in a modern, cloud‑based data environment.
Key Responsibilities
- Design, build, and maintain end‑to‑end data pipelines , including extraction, transformation, loading, and validation
- Onboard and integrate multiple data sources , including APIs and varied data formats
- Define and implement data transformation logic in partnership with stakeholders
- Perform unit testing, validation, and integration testing to ensure data integrity
- Collaborate with quality and analytics teams to support data validation processes
- Integrate data solutions into Snowflake or other cloud data warehouses
- Support pipeline optimization, performance tuning , and scalability improvements
- Deploy and maintain data solutions within Azure and Kubernetes environments
- Participate in Agile ceremonies and deliver work within 2‑week sprint cycles
Required Skills & Experience
4+ years of experience as a Data Engineer or in a related roleStrong hands‑on Python experience , including scripting and data ingestion from pipeline sourcesProficiency with SQL for data querying and transformationExperience with a cloud data warehouse (e.g., Snowflake or Databricks)Experience with ETL development and full pipeline ownershipExposure to unit testing, data validation, and integration testingFamiliarity with API integrations and handling diverse data formatsExperience working in cloud environments (Azure preferred)Nice to Have
Experience with KubernetesBackground working in Agile / Scrum environmentsExposure to data quality or data governance initiatives#J-18808-Ljbffr