Job Description
The Senior Data Engineer has the following responsibilities and duties :
- Be a member of the technical staff building solutions for the business.
- Design, implementation, testing, debugging, performance tuning, documentation, validation, and support of analytical solutions
- Translate business requirements into analytical solutions.
- Analyze, model and wrangle data and files to prep for utilization.
- Build data pipelines to move data into S3 and Redshift
Requirements
The Senior Data Engineer should have the following skills, education and experience :
Skills
Required :
- Excellent SQL and Python skills
- Experience with distributed computing languages (Spark, PySpark, Scala, SparklyR, etc)
- ETL / ELT hands-on experience with familiarity of Data Warehouse concepts
- Expertise in designing efficient Data Models
- Experience with Data Warehousing (Redshift, Snowflake, etc.)
- Knowledge of AWS services like EC2, EMR, Lambda, Glue, Athena, Kinesis Data Streams, Kinesis Firehose, etc.
- Knowledge of API-based integration and security (Restful and SOAP)
- Knowledge of IAM roles, Policies, etc.
- Experience in Data Visualization tools such as Tableau, Power BI etc.
- Ability to learn fast and translate data into actionable results.
- Excellent written and communication skills.
Preferred :
- Experience developing and supporting scalable data pipelines
- Experience with Snowflake
- Experience building cloud formation templates for workloads
- Familiar with EKS and ECS AWS services
- Solid Linux programming skills
- Experience building Data Platforms, Data lakes and Business Intelligence solutions.
Education
Bachelors in computer science, engineering, information technology or other related disciplines.
Aws Data Engineer
AWS Data EngineerLocation: Toronto, ON (HYBRID)Duration: Long term assignment Duties: Must haves:Onsite Lead with AWS + Database (Dynamo DB)10+ Yrs experience Experience with Database MigrationStrong team management and communication skills as this is a lead position for an extended small offshore ...
Sr. Manager, Data Engineer SRE
SRE, DevOps, or related roles, with a focus on cloud-based infrastructure (Azure, AWS, or GCP only) and automation. A genuine enjoyment of learning about how things work, with the ability to ask engineers good questions about architecture and product decisions. BS/MS/PhD in Computer Science/Engineer...
Sr. Gen AI GTM Specialist Solutions Architect, Data & AI GTM
Are you a customer-obsessed builder with a passion for helping customers achieve their full potential? Do you have the business savvy, Data & AI background, and sales skills necessary to help position AWS as the cloud provider of choice for customers? Do you love building new strategic and data-driv...
AWS Data Engineer
Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Perform data cleansing, data validation etc. AWS services like glue, glue crawlers, lambda, red shift, Athena, s, EC, IAM, Monitoring and Logging mechanisms- AWS CloudWatch, set...
Sr. Platform Engineer with Typescript (NodeJS) experience to work in AWS environment for a banking client
Integrate Integrated development with Azure services, including Azure Snowflake, Azure Databricks, Azure Astronomer for Airflow, ADLS Gen2, Kubernetes clusters, and databases. Collaborate with cross-functional teams, including architects, developers, and DevOps engineers, to deliver high-quality sol...
Integration Architect and Engineer, Data & Analytics
The purpose of the Data & Analytics Integration Architect and Engineer role is to drive innovation and efficiency by enabling data-driven decision-making processes, accelerating the pace of drug discovery, and enhancing regulatory compliance. Promote standards and policies for data management to inc...
Data Architect / Engineer (Azure)
Must have experience in leading a data warehouse implementation, including implementation of Data governance, Data management, Data quality, Data security, Data privacy standards (PIPEDA, PIPA). Data Architect /Engineer (Azure). Additionally, you will play an integral part in adding new and crucial ...
Clinical Data Architect & Engineer
Lead all data engineering tasks and implement data pipelines, ETL processes to ingest, transform, and load clinical data from various sources into the data infrastructure. The Clinical Data Architect and Engineer role serves the purpose of fostering innovation and operational efficiency through the ...
Sr Data Engineer
Do you have a passion for data? Then we are looking for you! We have an opportunity for a Data Engineer to join our Data & Analytics team, helping us unlock understandings and insights into our player base! As a Data Engineer, you will expand the pool of data available for conducting analytics i...
Senior AWS Data Engineer
Title: Senior AWS Data Engineer. Onsite Lead with AWS + Database (Dynamo DB). Experience with Database Migration. ...