Pipeline Jobs in Montreal-Est, QC

Job Title : ETL designerExperience : 12-15+ yearsLocation : Ottawa, ON Job Description : We are seeking a highly experienced ETL designer to join our team. The ideal candidate will have over 12-15 years of experience in designing and implementing data solutions, with a strong focus on cloud data warehousing and real-time data processing. This role requires advanced knowledge in various data technologies and the ability to translate business requirements into scalable and efficient data architectures. Key Responsibilities : Design, develop, and maintain robust ETL pipelines on GCP using tools like Dataflow, BigQuery, Cloud Composer (Apache Airflow), and Pub / SubOptimize data ingestion, transformation, and loading processes for high-volume, real-time, and batch data processingEnsure data integrity, quality, and security throughout the ETL lifecycleCollaborate with data engineers, analysts, and business teams to understand data needs and translate them into efficient ETL solutionsImplement best practices for performance tuning, error handling, and monitoring of ETL jobsWork with structured and unstructured data sources, integrating API-based, event-driven, and batch processing workflowsAutomate and document ETL processes to enhance maintainability and scalabilityUtilize Git for version control and deployment of ETL workflows, ensuring smooth CI / CD integrationKey Skills : 12+ years of experience in ETL design and developmentProficiency in SQL, Python, and Apache Beam for data processing using dataflow, dataproc appliances.Strong experience in advance DML operations, query optimizationStrong expertise in GCP services (BigQuery, Dataflow, Cloud Storage, Pub / Sub, Cloud Composer)Experience with data modeling, warehousing concepts, and data lakesHands-on experience with orchestration tools like Apache Airflow or Cloud Composer on DAG design, Error handling and monitoringKnowledge of performance tuning, data partitioning, and optimization techniquesExperience in real-time streaming ETL and event-driven architectures is a plusFamiliarity with Git for version control and deployment of ETL pipelinesStrong problem-solving skills and ability to work in an agile environmentQualifications : Bachelor’s or master’s degree in computer science, Information Technology, or a related field.Proven experience in ETL design and implementation in DWH systems.Strong problem-solving skills and the ability to work in a fast-paced environment.Excellent communication and collaboration skills.Preferred Qualifications : Experience with GCP Big Query and other cloud data warehousing solutions.Familiarity with modern data processing frameworks and tools.