Sr. Data & Analytics Engineer
Location : Calgary / Edmonton – Hybrid
Term : 1 year contract, Immediate Start
As a Sr. Data Engineer, you will be responsible for designing, building, and maintaining the infrastructure and systems that enable us to collect, store, and analyze vast amounts of data. You will work closely with data scientists, analysts, and other engineers to ensure that data is accessible, reliable, and secure.
Key Responsibilities
- Design and develop data pipelines : Create robust, scalable, and efficient data pipelines to process and manage large datasets.
- Data integration : Integrate data from various sources, including databases, APIs, and third-party systems, ensuring data consistency and quality.
- Data warehousing : Design and implement data warehousing solutions to support analytics and reporting.
- Performance optimization : Optimize and tune data processing systems for performance and cost efficiency.
- Data quality and governance : Implement data quality checks and governance practices to ensure data accuracy and compliance.
- Identify opportunities to enhance data quality, optimize data pipelines, and improve overall data infrastructure efficiency.
- Collaboration : Work closely with data architects, data scientists, analysts, and other stakeholders to understand their data needs and provide appropriate solutions.
- Documentation : Maintain clear and comprehensive documentation of data infrastructure, processes, and systems.
- Work with application, security, infrastructure, and other operational support teams, as well as project teams to resolve technical design, implementation, or operational technology issues
Knowledge / Skills / Abilities
Knowledge and experience in Data Modeling and Database Design, Data Storage and Data AnalyticsTechnical skills : Proficiency in programming languages such as Python, Java, or Scala.Data technologies : Experience with data processing frameworks like Apache Spark, Hadoop, or similar.Database management : Strong knowledge of SQL and experience with database systems such as MySQL.Experience in database and Extract-Transform-Load (ETL) architecture with Oracle, SQL Server and MySQL databases on multiple operating systems. Cloud platforms : Experience with cloud platforms preferably Azure.ITIL service delivery framework, including ITIL processes and best practices (including change management processes)Familiarity with data governance principles and practices.Problem-solving : Strong analytical and problem-solving skills.Communication : Excellent verbal and written communication skills. Attention to detail and a commitment to data accuracy and integrity.Continuous learning mindset, with a willingness to stay updated with the latest trends and advancements in data analytics.Preferred Qualifications
Bachelor’s degree in computer science, Information Technology, or a related field.Experience : 7+ years of experience in data engineering or a similar role.Certifications : Relevant certifications in data engineering or cloud platforms.Machine learning : Knowledge of machine learning techniques and tools.