Description de poste Role: Data Engineer with Capital Market Location: Toronto, ON - Canada Responsibilities
Manage timelines/deliverables within the team towards the successful delivery of projects.
Design software solutions by interacting with portfolio managers, traders, operations staff, and peers to understand requirements.
Develop solutions that are in line with the client's technology biases, deliver efficiency and scalability, and enable new trading activities.
Provide knowledge transfer to team members and support staff through application demos, walkthroughs, and documentation. Skills Must have
Basic Concepts: Data Mesh, Data Product
Expert in Data Pipelines: PySpark, Hudi, Iceberg, Airflow, EMR
Expert in Data Operations: Operational Excellence, monitoring, troubleshooting
Expert in Data Quality: Great Expectations, AWS Glue DQ, Deequ
Expert in Entitlements: AWS Lake Formation
Infrastructure: AWS Data Eng. Services (Glue, EMR, Athena, , AWS Compute Services (EC2, Lambda), AWS Storage Service (S3), cross-account IAM, RAM, MWAA, Step Functions, etc.
Knowledge in DevOps: Terraform, Git Actions
Expert in Metadata: Neptune, OpenLineage, Angular, DataZone
Knowledge in Consumption: AWS Athena, Trino
Expert in other Tools: JupyterLab, Databricks