Hello Applicant,
I have a full-time role available with my direct Fortune 500 client, directly on their payroll. They are seeking an "Data Engineer" with extensive experience in the Retail, entertainment & Sports domain.
This is a remote position
We are seeking a highly skilled and motivated Data Engineer with at least 4 years of experience. The ideal candidate will have strong expertise in SQL, Python, and AWS services, along with hands-on experience in building, managing, and optimizing data pipelines and architectures.
A deep understanding of data lake, data warehouse, and lakehouse concepts is essential. The role involves designing and implementing scalable ETL solutions to support various data-driven initiative
Key Roles and Responsibiliti
- es : Design and develop scalable and efficient ETL pipelines for both structured and unstructured da
- ta.Work extensively w ith AWS services, including S3, Lambda, Step Functions, Glue, EC2, EMR, SNS, SQS, Redshift, and Athe
- n a.Develop, monitor, and troublesho ot workflows usi ng Airfl ow and other scheduling / orchestration too
- ls.Build and mainta in data lakes, data warehouses, and lakehouse architectur es, ensuring optimal data fl
- ow.Implement and optimi ze S QL queries a nd Pyth on scripts for da ta extraction, transformation, and loading (ET
- L).Collaborate with data scientists, analysts, and stakeholders to translate business requirements into robust data solutio
- ns.Optimize data pipelines for performance, reliability, and scalability to handle growing datasets and business nee
- ds.Ensure data security, compliance, and governance in cloud-based environments using best practic
- es.Perform data quality checks to guarantee the accuracy and reliability of da
- ta.Stay up to date with the latest trends and technologies in data engineering, cloud platforms, and ETL developme
Key Qualificati
- ons : 4+ years of experie nce a s a Data Engineer, ETL Devel oper, or in a similar r
- ole.Proficiency in SQL and Pyt hon for data manipulation, automation, and process
ing.Extensive experience with AWS services, includ
- ing : S3, Lambda, Step Functions, Glue, EC2, EMR, SNS, SQS, Redshift, and Ath
- ena.Strong understan ding of data lake, data warehou se, and lakehouse architectu
- res.Experience with ETL framew orks and tools for building data pipeli
- nes.Hands -on experience with workflow orchestration tools l ike Air f
- low.Solid understanding of data governance, security, and complia nce best practi
- ces.Experience in build ing data models, optimizing datab ases, and query performance tun
- ing.Familiarity with mod ern data integrat ion patterns and data lake architect u
res.
Senior Data Engineer
They are seeking an "Data Engineer" with extensive experience in the Retail, entertainment & Sports domain. We are seeking a highly skilled and motivated Data Engineer with at least 4 years of experience. A deep understanding of data lake, data warehouse, and lakehouse concepts is essential. Collabo...
Senior Software Engineer, Data Engineering
The Data Engineering team at Lime is responsible for ingesting, transforming and making available timely, high-quality data that powers analytics, bookkeeping and visibility for a wide range of customers. Implement data governance policies and ensure data security and compliance. You have a strong d...
Data & Analytics - Senior Data Visualization Engineer
Data Visualization Engineer, you will combine your deep understanding of our digital experience, with your passion for data visualization and user experience to streamline, optimize, and innovate analytical interfaces that are easily absorbed, heavily adopted and drive high quality decision making a...
Data Engineer (Senior Consultant) - Future Opportunities
Perform data management tasks, including data architecture design and data modeling, master data/metadata/data security/privacy/data quality management, data operations, data integration and interoperability. Participate in architecture, development, deployment and maintenance of secure, extensive, ...
Software Engineer, User Data (Intermediate/Senior)
Working with large data sets and various databases including Aerospike, Elasticsearch, Redis, ScyllaDB, Redshift, TiDB, MariaDB. Our real-time advertising bidding system handles over 3,000,000 requests per second and stores several terabytes of data every day. Very strong problem solving skills in d...
Data & Analytics - Senior Data Visualization Engineer/Data Visualization Engineer
As the Senior Data Visualization Engineer, you will combine your deep understanding of our digital experience, with your passion for data visualization and user experience to streamline, optimize, and innovate analytical interfaces that are easily absorbed, heavily adopted and drive high quality dec...
Senior Analytics Engineer - Data Engineering (Remote - Canada)
Develop and maintain the content and structure within data storage solutions including data lakes and data warehouses, ensuring data is accurately organized, enriched, and ready for analysis. In this role, you'll design and build robust data pipelines to manage large volumes of data, ensuring seamle...
Data & Analytics - Senior Data Platform Engineer
As the Senior Data Platform Engineer, you will leverage modern software development and operational practices while following an "automation first" approach to support the acquisition, ingestion, transformation, and management of our data. As the Senior Data Platform Engineer, you will:. The Senior ...
Senior Data Engineer - Data Insights (Remote) (Canada)
Proven experience as a big data engineer or a similar role, with a deep understanding of big data technologies, frameworks, and best practices. Building and maintaining data infrastructure, including data lakes, data warehouses, and real-time streaming platforms. Developing and optimizing data pipel...
Senior Consultant/ Manager - Microsoft Azure & Microsoft Fabric Data Engineer
Hands on experience with data processing and analytics using Azure Data Factory, Azure Synapse, Azure Data Lake or Azure Databricks is a plus. Contribute to the design and development of enterprise-level data solutions, including data warehouses, data lakes, and real-time analytics platforms, using ...