Our large energy client is seeking a Senior Data Engineer to develop, test, and maintain ETL pipelines using Python and SQL in an Azure Data Factory and Databricks environment
Contract would be starting ASAP until December 31, ; with high probability of extension.
Must Haves :
- 5+ yrs Data Engineer proficient in Python and SQL
- 5+ yrs Azure Data Factory (ADF)
- 5+ yrs experience with Databricks development
- Extremely comfortable handling and manipulating large data sets and handling raw SQL data
- Some experiencecreating ETL pipelines from scratch
Nice to Haves :
- Familiarity with Pyspark, ADO (AcriveX Data Objects), Docker
- Experience in Agile environment a preference
- DBT (Data Build Tool) modelling
- Experience in Oil & Gas industry would be an asset
Responsibilities :
- Developing, testing, and maintaining data pipelines
- working closely with stakeholders to understand data needs and delivering scalable data applications and analytics
- Be a problem solver who can understand and handle complex data challenges
- Will be responsible for peer code reviews
- Has a solid understanding of data architecture
Senior Data Engineer to develop, test, and maintain ETL pipelines using Python and SQL in an Azure Data Factory and Databricks environment
Senior Data Engineer to develop, test, and maintain ETL pipelines using Python and SQL in an Azure Data Factory and Databricks environment. Extremely comfortable handling and manipulating large data sets and handling. Developing, testing, and maintaining data pipelines. Be a problem solver who can u...
Nanny Wanted - Looking For A Reliable And Caring Nanny In Calgary, Alberta $22/Hr
Your responsibilities will include supervising and interacting with our children, preparing meals, organizing activities, and maintaining a tidy living space. Are you a nurturing, reliable, and experienced caregiver looking for a rewarding opportunity? Our family in Calgary, Alberta is seeking a res...
Senior Project Engineer Manager - Relocation to USA
Our client is a global leader within the dairy industry, over recent years they have seen continuous growth both in the US and internationally, their core product area has seen a surge in demand and due to several high profile acquisitions they continue to bolster their product offering. They are hi...
data entry clerk
Store, update and maintain databases. Transfer handwritten data to Excel or Word documents. Enter data according to specified format. Are you currently legally able to work in Canada?. ...
Intermediate Document Controller to manage and maintain engineering documents for multiple, concurrent projects within a midstream portfolio
P&ID’s, Plot Plans and Engineering Drawings. Our Calgary energy client is hiring an. Intermediate Document Controller. ...
Senior Manager, Digital & Automation, AOA- Future Opportunity
You will also have opportunities to serve clients and / or support local office teams around the country and / or internationally, contribute to market and eminence initiatives (including development of new service offerings and marketing campaigns within the practice), develop materials for and par...
Int. Business Analyst to support the Process Adoption and all projects prioritized within the Digital Transformation for our large Telco client - 18986
Analyze, document and validate business requirements from business users and function specification requirements using interviews, document analysis, task and workflow analysis. Interface between business and technical teams and translate technical and business requirements. Business Analyst to supp...
Senior Health & Benefits Consultant
Through its market-leading businesses including Marsh, Guy Carpenter and Oliver Wyman, Marsh McLennan helps clients navigate an increasingly dynamic and complex environment. Leading complex client engagements, including managing overall service delivery, strategy, financial evaluations, plan design,...
Customer Service Advisor and Technical Support Advisor - Mobile Devices and Services - Work-at-Home - CANADA
Although the computer is provided if you are hired, you will need a home desktop or laptop computer that is hardwired using an Ethernet connection to complete the typing and internet speed assessments during the application. We are 30,000+ customer experience specialists at over 60 contact centers a...
Data Engineer
Engineering background (data pipeline, data ingestion, data warehousing, data analytics). For this role, the Engineer will join a team that manages the data lakes within the Google Cloud. A successful candidate will have Cloud experience and strong python and SQL experience. The Select Group is seek...