Senior Data Engineer

We are seeking a skilled Senior Data Engineer with a strong emphasis on leadership capabilities to join our DataOps team and play a key role in building and optimizing data pipelines on Google Cloud Platform .

In this role, you will play a pivotal part in designing and optimizing data pipelines in Google Cloud Platform while also focusing on architectural design, documentation, and knowledge sharing within the team.

Responsibilities :

• Design, develop, and maintain data pipelines leveraging Google Cloud products such as Cloud BigQuery, Google Cloud Storage, Cloud Pub / Sub, and Cloud BigTable.
• Draft architecture diagrams to visualize data flow and system components for effective communication within the team.
• Develop comprehensive documentation to ensure knowledge transfer and maintain best practices.
• Implement and uphold data governance frameworks to ensure data quality, security, and compliance.
• Optimize cloud costs by efficiently managing resources on Google Cloud Platform.
• Drive innovation by spreading best practices and fostering a culture of continuous improvement within the team.
• Contribute to the implementation of Data Warehouses or Big Data projects using technologies like Kafka, DataProc, Hadoop, Spark, etc.

Requirements :

• 3+ years of demonstrated experience in data analytics, deploying distributed data processing systems, and data governance.
• Proficiency in Python, Go, Java, or other coding languages.
• Hands-on experience with Google BigQuery including query optimization and large dataset management.
• Expertise in designing and maintaining robust data pipelines for efficient data flow.
• Strong background in data warehousing concepts and best practices.
• Advanced analytics skills for deriving insights from complex datasets.
• Leadership qualities with a focus on knowledge sharing and fostering a culture of continuous improvement.
• Cloud certification (e.g., Google Cloud Platform) is preferred.

Additional Skills :

• Experience in drafting architecture diagrams to visualize system components and data flow.
• Strong commitment to writing comprehensive documentation for knowledge transfer.
• Ability to spread best practices and drive innovation within the team.
• Knowledge of real-time streaming and processing of diverse data sources.
12 days ago