Senior Software Developer, Big Data

Position Overview

Autodesk is looking for a Senior Software Developer, Big Data with experience building data pipelines to join our Enterprise Data Engineering & Visualisation (EDEV) team.

The EDEV Team is chartered with building data pipelines and solutions that allow our users to obtain important business insights.

These solutions serve as the building blocks for all data engineers, data scientists and data analysts throughout the organisation.

Also, this team establishes and promotes data engineering best practices across Autodesk, leading efforts to make data an integral part of decision-making at Autodesk.

You will build data solutions for complex data transformation pipelines, and lending technical expertise within the group.

You will report to Senior Software Development Manager based in the US. This role is based out of Toronto, in a hybrid mode.

Autodesk supports FLEX working model.

Responsibilities

Automate data transformations against data sourced from a variety of systems including desktop, web, and mobile product usage logs and business systems data

Develop solutions applying CI / CD processes to orchestrate automated batch and NRT (Near Real Time) pipelines running PySpark and dbt data transformations using Apache Airflow

Use programming languages used for data manipulation, including SQL, Python, Spark, PySpark, Spark SQL, Java, Jinja

Design, develop, execute, and document software solutions to address complex data collection, processing, transformation, and testing

Collaborate with peer organisations, DevOps, support organisations on technical issues and help troubleshoot code level problems and performance issues

Recommend architectural standards, best practices and quality assurance processes for data related systems and applications

Build data quality and durability tracking mechanisms to provide visibility into and address changes in data ingestion, processing, and storage

Lead and / or help design data schemas to ensure common protocols and storage mechanisms are used across all data services

Partner with data and software architects to design data models, APIs or other architectural elements

Minimum Qualifications

5 years of experience in cloud ETL, ELT and near-real time data collection, transport, and processing technologies

3+ years of experience with data modeling, including the design of schemas optimized for data retrieval

5+ year of experience in programming with SQL, Python, Spark, PySpark, Spark SQL, Java, Jinja and related languages

3+ years of experience working with a big data environment including Hadoop, Hive, Spark and Presto

Experience creating detailed technical documentation which addresses business requirements

Experience architecting and implementing data testing solutions

Experience working with a big data environment including Hadoop, Hive, Spark and Presto

Proficiency in building data transformation and analysis using PySpark and dbt

Experience working with workflow management tools, like Airflow and Azkaban

Experience working with GitHub, Jira, and Jenkins

Familiarity with data governance frameworks, SDLC (Software Development Life Cycle), and Agile methodology

Strong technical and problem-solving skills and continuous interest in learning best of class technologies around data warehousing, data wrangling, data quality, data governance and data ethics

Learn More

About Autodesk

Welcome to Autodesk! Amazing things are created every day with our software from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies.

We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

When you’re an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all.

Ready to shape the world and your future? Join us!

Salary transparency

Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location.

In addition to base salaries, we also have a significant emphasis on discretionary annual cash bonuses, commissions for sales roles, stock or long-term incentive cash grants, and a comprehensive benefits package.

Diversity & Belonging

We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here :

Are you an existing contractor or consultant with Autodesk?

Please search for open jobs and apply internally (not on this external site).