Role : Lead Data Enguneer
Location : Toronto, ON (hybrid)
Job Description :
years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Redshift.
Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred).
Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc
- Hands on ETL developer who is good at python, SQL. AWS services like glue, glue crawlers, lambda, red shift, athena, s, EC, IAM, Monitoring and Logging mechanisms- AWS cloudwatch, setting up alerts.
- Deployment knowledge on cloud. Integrate CI / CD pipeline to build artifacts and deploy changed to higher Environments.
- Scheduling frame works Airflow, AWS Step functions
- Excellent Communication skills, should be able to work collaboratively with other teams.
Thanks and Regards
Saurabh Srivastava
Account Manager
Lead Data Engineer
Lead the design and implementation of reliable data pipelines and data storage solutions. Lead the development and maintenance of data pipelines and ETL processes using technologies such as Dagster and DBT to ensure efficient data flow and processing. Collaborate with Engineering Leadership and Prod...
Lead Data Engineer
Active Learning, Agile Methodology, Amazon Redshift, Apache Hadoop, Apache Spark, Application Integrations, AWS Cloud Computing, Data Pipelines, Data Science, Detail-Oriented, Emerging Technologies, Enterprise Application Delivery, Group Problem Solving, Kotlin Programming Language, Machine Learning...
GCP Lead Data Engineer
OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developer</li> <li>Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc. Experience with Goog...
Lead Data Engineer
Platform Engineering Big Data team is looking for a Lead Data Engineer for on-premises Data Platform and will be involved as well in business sponsored programs including Compliance and Regulatory work. Big Data, Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousi...
Lead Data Engineer
Lead the design and implementation to re-platform, re-architecture solutions, bringing in expertise in development process, leveraging modern build and deployment tools and best practices. Work with Business lines to understand credit risk data, provide meaningful insights and help with implementati...
Sr. Data Engineer to perform ETL development (PostgreSQL) on Guidewire billing/policy/claims center for a major insurance client
Data Analysis: Understanding the data structures and terminology used in Guidewire applications will be essential for performing accurate data analysis and troubleshooting. Data Engineer to perform ETL development (PostgreSQL) on Guidewire billing/policy/claims center for a major insurance client . ...
Sr. Data Engineer
Be a key part of Momentum’s Data strategy by developing the next-gen Dynamic Data Engineering framework. Lead and enhance data lake platform acquiring additional data sources - structured and unstructured. Good to have: Strong knowledge on Big Data technologies such as Data Bricks, Event driven data...
Lead Full Stack Data Engineer, Data Foundation, Data Platforms
Build/manage data pipelines, and common data related cross cutting concerns like data catalog, data lineage, data quality, data profiling, data discovery, metadata management. Hands on experience on building cross cutting concerns like data catalog, data lineage, data quality, data profiling, data d...
Associate Director- Lead Data Engineer
Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Problem Solving, Quality Management, Requirements Analysis. We are seeking for a highly skilled Data Engineer to join our team and work on building Data Monetization products. Highly...
Sr. Software Engineer - Data
Data Platform Engineer at Egen, you will architect and implement cloud-native data pipelines and infrastructure to enable analytics and machine learning on Egen's rich datasets. Egen's Data Engineering team builds scalable data pipelines using Python, Java, or Scala and AWS. We drive valuable Digita...