Job Description
Software Developer - ETL - Senior
Pay Rate : Flexible
Location : 315 Front Street
Contract Length : 4 Months
Work Type : Hybrid
We at Raise are hiring right now for one of our Ontario Public Sector Clients. If you’re interested, apply below for your chance to join a great place to work.
Responsibilities :
- This role is responsible for designing, developing, maintaining, and optimizing ETL (Extract, Transform, Load) processes in Databricks for data warehousing, data lakes, and analytics.
- The developer will work closely with data architects and business teams to ensure the efficient transformation and movement of data to meet business needs, including handling Change Data Capture (CDC) and streaming data.
Qualifications :
- Ability to collaborate effectively with cross-functional teams and communicate complex technical concepts to non-technical stakeholders.
- Strong problem-solving skills and experience working in an Agile or Scrum environment.
- Ability to provide technical guidance and support to other team members on Databricks best practices.
- Must have previous work experience in conducting Knowledge Transfer sessions, ensuring the resources will receive the required knowledge to support the system.
- Must develop documentation and materials as part of a review and knowledge transfer to other members.
Must Haves :
- 7+ years using ETL tools such as Microsoft SSIS, stored procedures, T-SQL
- 2+ Delta Lake, Databricks and Azure Databricks pipelines :
- Strong knowledge of Delta Lake for data management and optimization.
- Familiarity with Databricks Workflows for scheduling and orchestrating tasks.
- 2+ years Python and PySpark
- Solid understanding of the Medallion Architecture (Bronze, Silver, Gold) and experience implementing it in production environments.
- Hands-on experience with CDC tools (e.g., GoldenGate) for managing real-time data.
- SQL Server, Oracle
Il y a 1 jour