Role Description :
- Designing and developing data pipelines using Cloud Technologies based on business requirements and technical design.
- Collaborating with Stakeholders, Business Analysts and Data Architects to assist and translate business requirements to technical solutions
- Develop big data and analytic solutions leveraging new or existing technology to advance client’s all lines of business
- Exploratory data analysis by querying and processing data stores and databases and generate reports.
- Design, upgrade and implement new data workflows.
- Write and maintain technical documentation
- Executes updates, patches, and other activities required to maintain and enhance the operations of on-premise or cloud-based environments
Competencies : Data Structures
Experience (Years) : 4-6
Essential Skills :
- Experience working as Data Engineer with focus on big data processing and / or relational databases with good understanding of SQL
- Experienced with working on Structured and Semi-Structured datasets.
- Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database, Azure Data Factory, ADLS storage account, Azure Data Bricks and DevOps Experienced in creating data pipelines & developing complex and optimized queries
- Experienced with Workflow Management Tools : Airflow, Crontab, CA Workload Automation
- Experience with implementing CI / CD pipeline on GitHub, Jenkins / JGP.
- Experience writing complex SQL and NoSQL jobs to analyze data in traditional DBMS (MS-SQL, Oracle) environments
- Experience with integrating to back-end / legacy environments
- Experience integrating business and technology teams
- Experienced in any of the following programming / scripting languages (SQL, Python, Shell, Scala) Excellent organizational and time management skills, strong business presence with ability to multi-task and effectively deal with competing priorities
Desirable Skills :
- Previous work experience in the financial sector (insurance or benefits industry).
- Knowledgeable or at least have the basic concept of Data Visualization in any of the following tools : Tableau, PowerBI, QlikView / QlikSense
Azure Data Engineer
Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL. Azure Data Engineer (minimum years exp) NO junior profile. Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud. Strong SQL skills ( T-SQL or PL-SQL). ...
Senior Sales Representative (Hunter), National Accounts
Senior Sales Representative for National Accounts (HUNTER).Are you motivated by always progressing and achieving more?.Does nothing stop you from persevering until you get things right?.Have you got the power to transform problems into first-class solutions?.YES? You might be just the person we're l...
Azure Data Architect
Architecting, Planning and Implementation of end- to- end Data Warehouse and Business Intelligence systems utilizing best practices from Data Architecture, Data Integration and Data Management areas. Azure Data Bricks, ADF, Python, Spark, SQL, Unix Shell Scripting. Perform data analysis, data modell...
Data Engineer (1674) $70/hr
You'll join the Data, Analytics & AI team, a multidisciplinary group of data scientists, data analytics specialists, data engineers, and data visualization experts. You will collaborate with Middleware/Product/Data Engineering, Data Scientists, and business stakeholders to deliver a well-managed and...
Senior Data Engineer
Applying to the position, you may join one of the most respected and fastest growing institutional investors in the world.Our client is a professional investment management organization that globally invests the funds to ensure long-term sustainability.The company invests in all major asset classes,...
Azure ML engineer
We are looking for a talented and highly effective Sr.Developer to join our development and support team.We are currently supporting, enhancing and maintaining the statewide SNAP,'TANF Eligibility Determination and ancillary application registration system.The enhancements Include use of latest tech...
Data Engineer, Scotiabank
Designing, building, operationalizing the Customer Profile Database using Google Cloud Platform (GCP) data services such as DataProc, Dataflow, CloudSQL, BigQuery, CloudSpanner in combination with third parties such as Spark, Apache Beam/ composer, DBT, Cloud PubSub, Confluent Kafka, Cloud storage C...
WFM Consultant
Support data migration activities like data cleansing, mapping and conversion. This is a client facing role, you will connect with clients directly, manage conversations, data collation, and perform necessary activities with the client for the migrations of projects. ...
QE Big Data Lead
Data QE Lead with 8+ years QE and lead experience on ETL, Big Data & Python skills. Strong Test Lead with 5+ years of functional testing experience, including 3+ years of testing in ETL, database, Big Data environment. Complex query writing, procedures, routines in Big Query. Proven knowledge & ...
Senior Data Engineer - Capital Market - Toronto, ON
Role: Data Engineer with Capital Market. Basic Concepts: Data Mesh, Data Product. Expert in Metadata: Neptune, OpenLineage, Angular, DataZone. Expert in Data Pipelines: PySpark, Hudi, Iceberg, Airflow, EMR. ...