Job Description
The Senior Data Engineer has the following responsibilities and duties :
- Be a member of the technical staff building solutions for the business.
- Design, implementation, testing, debugging, performance tuning, documentation, validation, and support of analytical solutions
- Translate business requirements into analytical solutions.
- Analyze, model and wrangle data and files to prep for utilization.
- Build data pipelines to move data into S3 and Redshift
Requirements
The Senior Data Engineer should have the following skills, education and experience :
Skills
Required :
- Excellent SQL and Python skills
- Experience with distributed computing languages (Spark, PySpark, Scala, SparklyR, etc)
- ETL / ELT hands-on experience with familiarity of Data Warehouse concepts
- Expertise in designing efficient Data Models
- Experience with Data Warehousing (Redshift, Snowflake, etc.)
- Knowledge of AWS services like EC2, EMR, Lambda, Glue, Athena, Kinesis Data Streams, Kinesis Firehose, etc.
- Knowledge of API-based integration and security (Restful and SOAP)
- Knowledge of IAM roles, Policies, etc.
- Experience in Data Visualization tools such as Tableau, Power BI etc.
- Ability to learn fast and translate data into actionable results.
- Excellent written and communication skills.
Preferred :
- Experience developing and supporting scalable data pipelines
- Experience with Snowflake
- Experience building cloud formation templates for workloads
- Familiar with EKS and ECS AWS services
- Solid Linux programming skills
- Experience building Data Platforms, Data lakes and Business Intelligence solutions.
Education
Bachelors in computer science, engineering, information technology or other related disciplines.
Aws Data Engineer
Onsite Lead with AWS + Database (Dynamo DB). Experience with Database Migration. A strategic partner to Fortune 500 and other top companies in financial services and many other industries, Iris provides a value-driven approach - a unique blend of highly-skilled specialists, software engineering expe...
Sr Data Engineer
Do you have a passion for data? Then we are looking for you! We have an opportunity for a Data Engineer to join our Data & Analytics team, helping us unlock understandings and insights into our player base! As a Data Engineer, you will expand the pool of data available for conducting analytics i...
Sr. Platform Engineer with Typescript (NodeJS) experience to work in AWS environment for a banking client
Integrate Integrated development with Azure services, including Azure Snowflake, Azure Databricks, Azure Astronomer for Airflow, ADLS Gen2, Kubernetes clusters, and databases. Collaborate with cross-functional teams, including architects, developers, and DevOps engineers, to deliver high-quality sol...
Sr. Manager, Data Engineer SRE
SRE, DevOps, or related roles, with a focus on cloud-based infrastructure (Azure, AWS, or GCP only) and automation. A genuine enjoyment of learning about how things work, with the ability to ask engineers good questions about architecture and product decisions. BS/MS/PhD in Computer Science/Engineer...
Integration Architect and Engineer, Data & Analytics
Possess subject matter expertise on creating a data mesh or federated data architecture that can tap into data among disparate data warehouses, real-world data, and file-based data (structured and unstructured). The purpose of the Data & Analytics Integration Architect and Engineer role is to drive ...
Clinical Data Architect & Engineer
Lead all data engineering tasks and implement data pipelines, ETL processes to ingest, transform, and load clinical data from various sources into the data infrastructure. The Clinical Data Architect and Engineer role serves the purpose of fostering innovation and operational efficiency through the ...
Sr. Data Engineer to develop ETL/ELT for analytics solutions using Python for our large banking client - 34378
Support the Senior Data Engineer in defining data quality metrics and processes to monitor data in production environment. ETL/ELT, data pipelines, or data engineering solutions. Data Engineer to develop ETL/ELT for analytics solutions using Python for our large banking client -. The purpose of this...
Sr. Gen AI GTM Specialist Solutions Architect, Data & AI GTM
Are you a customer-obsessed builder with a passion for helping customers achieve their full potential? Do you have the business savvy, Data & AI background, and sales skills necessary to help position AWS as the cloud provider of choice for customers? Do you love building new strategic and data-driv...
Integration Architect and Engineer, Data & Analytics
The purpose of the Data & Analytics Integration Architect and Engineer role is to drive innovation and efficiency by enabling data-driven decision-making processes, accelerating the pace of drug discovery, and enhancing regulatory compliance. Promote standards and policies for data management to inc...
Sr. Information Architect - Ratings Data Technology Lead (Hybrid)
Provide technical expertise in the areas of database design and implementation, services, master data management, data modeling, data quality, data governance, data access & data integration. As a data architect, you are well respected by engineers and non-engineers alike. Domain Model, Referenc...