Cloud Data Engineer
Position Description :
Location : Hybrid / GTA
Job Type : Full-Time
We are seeking a highly skilled and experienced Cloud Data Engineer to join our dynamic team. In this role, you will play a crucial role in designing and implementing cutting-edge data solutions using a variety of technologies and platforms.
Your future duties and responsibilities :
- Redesign, develop, and maintain scalable and efficient data solutions on the cloud platform.
- Implement and optimize data pipelines using GCP services such as BigQuery, Dataflow, PubSub, and Data Migration tools.
- Build and maintain data warehouses for efficient data storage, retrieval, and analysis.
- Troubleshoot and debug issues related to data pipelines, ensuring smooth and reliable data flow.
- Collaborate with the Data and Analytics team to design and implement data-driven solutions.
- Utilize ELK, Grafana, and other monitoring tools to ensure optimal performance and observability of data systems.
- Work with Looker to handle large-scale data processing and reporting requirements.
- Apply Site Reliability Engineering (SRE) principles to enhance system reliability, incident management, and operations.
- Develop and maintain a robust observability framework for monitoring, alerting, and tracking data system performance.
- Collaborate with cross-functional teams to integrate data systems via APIs and ensure seamless data integration.
- Familiarity with common data pipeline issues and their solutions
Required qualifications to be successful in this role :
- Bachelor’s degree in computer science, Engineering, or a related field.
- Proven experience working with GCP services including BigQuery, Dataflow, PubSub, and Data Migration tools.
- Strong proficiency in data warehouse design and implementation.
- Proficiency in troubleshooting and debugging data pipeline issues.
- Solid understanding of data and analytics principles.
- Experience with ELK stack and Grafana for monitoring and observability.
- Familiarity with Hadoop, Looker, and other relevant data processing and reporting tools.
- Knowledge of Site Reliability Engineering (SRE) principles and incident management.
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
- Experience with Kafka and API integration is a plus.
Join our team of cloud professionals and contribute to the success of our cutting-edge projects. We offer a competitive salary, comprehensive benefits package, and a stimulating work environment.
LI-LP6
Skills :
Principal Software Engineer – Calix Cloud - Network Data Platform
Good Experience with load balancers, WebSockets and similar technologies at different layers for efficient data abstraction and transfer for large scale data connections / large flow of data. Strong background in transactional databases and good understanding and experience with no-SQL datastores an...
Cloud Data Engineer
We are seeking a highly skilled and experienced Cloud Data Engineer to join our dynamic team. Implement and optimize data pipelines using GCP services such as BigQuery, Dataflow, PubSub, and Data Migration tools. Redesign, develop, and maintain scalable and efficient data solutions on the cloud plat...
Application Data Architect
SAAS solutions - focused on AI technologies such as security in Generative AI, SAAS based AI solutions involving data analytics, AI in collaboration technologies, AI technologies such as Google Bard, Azure Open AI, Open AI, etc. Knowledge in API security, data analytics environments, scripting in we...
Solutions Architect
Job Title: Solutions Architect. Due to extensive growth, our client is looking to recruit an experienced Solutions Architect. AWS Certification at Associate level or equivalent (preference for Solutions Architect). Experiencing architecting, implementing and supporting Amazon Web Services infrastruc...
AWS Data Engineer (Remote - Canada)
As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. Proven experience as a Data Engineer or similar role, with a strong focus on AWS data services. We are seeking a talented Data Engineer to join our dynamic team. Troubleshoot and resol...
Salesforce Solution Architect
Role: Salesforce Solution Architect. Design innovative Salesforce solutions that integrate seamlessly with other systems and meet technical and business needs. Lead and provide expertise on Salesforce projects, ensuring the architecture is scalable and future-proof. Mentor and provide architectural ...
Fraud Data Analyst
We're looking for a skilled Fraud Data Analyst to protect our mobile gaming ecosystem. Fraud Data Analysis & Investigation:. Clean, transform, and manipulate datasets to prepare them for analysis. Develop and maintain fraud monitoring protocols, proactively analyzing player data to uncover suspiciou...
Data Architect - Adobe Experience Platform
As a Data Architect specializing in Adobe Experience Platform, you will lead data architecture initiatives and drive the integration of Adobe solutions into our data environment. You'll leverage your deep understanding of data design, database architecture, and metadata management to create personal...
Data Architect
Title: Data Engineer/Architect - Data Catalog & SAP Integration. Headquartered in San Diego, CA truData is a technology services provider and a data-oriented company specializing in data and analytics and integration offerings delivered through cloud solutions. ...
Data Analyst
The Data Analyst's technical skills will be put to the test as they shape data into a crispy. Data Analysts and Scientists, using all the skills in order to exploit data to drive the business forward. This will push the envelope of what is possible within the big data space; streaming live data into...