Recherche d'emploi > Toronto, ON > Senior data engineer

Senior Data Engineer w/HUDI

Algobrain
Toronto, ON, CA
112.4K $-156.1K $ / an (estimé)
Temps plein
Quick Apply

This role is 4 days a week onsite Project description Our client is a professional investment management organization that globally invests the funds to ensure long-term sustainability.

The company invests in all major asset classes, including public equity, private equity, real estate, infrastructure and fixed-income instruments.

Client attracts and selects high-caliber individuals from top-tier institutions around the globe. Join our team and look forward to : Diverse and inspiring colleagues and approachable leaders Stimulating work in a fast-paced, intellectually challenging environment Accelerated exposure and responsibility Global career development opportunities Being motivated every day by important social purpose and unshakable principles A deeply rooted culture of Integrity, Partnership and High Performance If you share a passion for performance, value a collegial and collaborative culture, and approach everything with the highest integrity, here's an opportunity.

Responsibilities Manage timelines / deliverables within the team towards the successful delivery of projects. Design software solutions by interacting with portfolio managers, traders, operations staff and peers to understand requirements.

Develop solutions that are in line with client's technology biases, deliver efficiency and scalability, and enable new trading activities.

Provide knowledge transfer to team members and support staff through application demos, walkthroughs, and documentation.

Required Skills Concepts : Data Mesh, Data Product Data Pipelines : PySpark, Hudi, Iceberg, Airflow, EMR Data Operations : Operational Excellence, monitoring, troubleshooting Data Quality : Great Expectations, AWS Glue DQ, Deequ Entitlements : AWS Lakeformation Infrastructure : AWS Data Eng.

Services (Glue, EMR, Athena etc.), AWS Compute Services (EC2, Lambda), AWS Storage Service (S3), cross-account IAM, RAM, MWAA, Step Functions, etc.

DevOps : Terraform, Git Actions Metadata : Neptune, OpenLineage, Angular, DataZone Consumption : AWS Athena, Trino Other Tools : JupyterLab, Databricks SQL We are looking for experienced support whereby experience means comfortable working with production-level code and assets with clear understanding of DevOps and DataOps principles. Powered by JazzHR

Il y a 24 jours
Emplois reliés
Offre sponsorisée
CloudGeometry
Toronto, Ontario

We are looking for a Senior Data Engineer with extensive hands-on experience in the Databricks ecosystem and exceptional communication skills to join our flagship project: a cutting-edge Data Platform for the life sciences industry. Implement data ingestion from various sources into Databricks, ensu...

Offre sponsorisée
RI-MUHC | Research Institute of the MUHC | #rimuhc,
Canada

The data engineer is responsible for architecting, implementing, and maintaining compute frameworks, analysis tooling, and/or model implementations used or created by the Data Science team to support the management and analysis of clinical and administrative data at the McGill University Health Cent...

TextNow
Canada

Be a champion of TextNow's data ecosystem by working with data science, engineering and infrastructure to implement data strategy for governance, security, privacy, quality,and retention that will satisfy business policies and requirements. Mentor junior data engineers and promote best practices in ...

PwC
Toronto, Ontario

Data Integration: Design and implement processes for data acquisition, storage, transformation, and retrieval from various sources, ensuring data quality and integrity but also seamless integration of large-scale datasets allowing our clients to fully leverage the value of their investment into thei...

Lyons Consulting Group
Toronto, Ontario

As a Team Lead, you will build distributed data processing solution and highly loaded database solutions for various cases including reporting, product analytics, marketing optimization and financial reporting. Manage a team of authority data engineers working on the foundation for decision-making a...

Cloudbeds
Canada
Télétravail

Proven experience as a big data engineer or a similar role, with a deep understanding of big data technologies, frameworks, and best practices. Building and maintaining data infrastructure, including data lakes, data warehouses, and real-time streaming platforms. Developing and optimizing data pipel...

Ontario Power Generation
Toronto, Ontario

Collaborate with business analysts, data scientists, data engineers, data analysts and solution architects to develop data pipelines to feed our data marketplace. Reporting to the Senior Manager, Enterprise Data Lake Deployment, the Senior Data Developer is responsible for designing, building and su...

Manulife
Toronto, Ontario

You will contribute to the development and implementation of data pipelines and ETL processes to extract, transform, and load data into Manulife's data warehouse and utilize your expertise in building pipelines using, Python, Azure Data Factory, Databricks, Synapse, SQL server, and Azure functions t...

Faire
Canada

Our experienced data scientists and machine learning engineers are developing solutions related to discovery, ranking, search, recommendations, ads, logistics, underwriting, and more - all with the goal of helping local retail thrive. Our team already includes experienced Data Scientists and Machine...

Capgemini
Toronto, Ontario

Our people extend into all industries we conduct work with our clients in the areas of; data science, data engineering, data strategy, intelligent process automation, data ecosystems, intelligent industry/IoT, enterprise management, customer-first marketing, and data partnerships/disruptors (such as...