Our valued professional services client client is seeking a Senior Data Engineer Team Lead to oversee critical data engineering activities within the Digital Health sector.
10 month contract (with possible extension), % Remote
Responsibilities :
- Provide strategic oversight of data engineering activities, shaping platform strategy and data architecture.
- Act as a technical leader for the team, establishing best practices for data engineering.
- Collaborate with senior leadership and external stakeholders as the senior technical resource for the group.
- Monitor and optimize ARC platform data pipelines to ensure efficient data flow and system performance.
- Work with stakeholders and data SMEs to identify and implement enhancements to ARC platform capabilities.
- Conduct advanced data profiling and quality assessments to ensure data health and integrity.
- Implement and manage data access policies in coordination with the Data Governance and Engineering team.
- Troubleshoot and resolve data-related issues in collaboration with operational support teams.
- Work with source systems to identify and transport necessary data, using methodologies such as SQL, NoSQL, and RESTful.
- Document data extraction processes, optimizations, and enhancements for reference and compliance.
- Apply and update classifications for personal health information (PHI) data elements as required.
- Provide custom data quality rules and conduct associated scans on the data estate.
- Facilitate access to draft materials and ensure feedback is obtained prior to final delivery.
- Produce comprehensive documentation for data pipeline optimizations, operational support, and user training materials.
- Write status reports outlining completed activities and outstanding issues or risks.
Must Have Skills :
7+ years of experience in data engineering, with at least 3 years in a team lead or technical leadership role.Experience with data profiling , quality assessments , and governance policies (Master Data Management).Strong knowledge of data pipeline optimization and data architecture.Proficiency in SQL, NoSQL, and RESTful methodologies.Nice to Have Skills :
Familiarity with data security and compliance regulations related to personal health information (PHI).Knowledge of data integration tools and techniques.