Job Description
Role Description :
- Designing and developing data pipelines using Cloud Technologies based on business requirements and technical design.
- Collaborating with Stakeholders, Business Analysts and Data Architects to assist and translate business requirements to technical solutions
- Develop big data and analytic solutions leveraging new or existing technology to advance client’s all lines of business
- Exploratory data analysis by querying and processing data stores and databases and generate reports.
- Design, upgrade and implement new data workflows.
- Write and maintain technical documentation
- Executes updates, patches, and other activities required to maintain and enhance the operations of on-premise or cloud-based environments
Competencies : Data Structures
Experience (Years) : 4-6
Essential Skills :
- Experience working as Data Engineer with focus on big data processing and / or relational databases with good understanding of SQL
- Experienced with working on Structured and Semi-Structured datasets.
- Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database, Azure Data Factory, ADLS storage account, Azure Data Bricks and DevOps Experienced in creating data pipelines & developing complex and optimized queries
- Experienced with Workflow Management Tools : Airflow, Crontab, CA Workload Automation
- Experience with implementing CI / CD pipeline on GitHub, Jenkins / JGP.
- Experience writing complex SQL and NoSQL jobs to analyze data in traditional DBMS (MS-SQL, Oracle) environments
- Experience with integrating to back-end / legacy environments
- Experience integrating business and technology teams
- Experienced in any of the following programming / scripting languages (SQL, Python, Shell, Scala) Excellent organizational and time management skills, strong business presence with ability to multi-task and effectively deal with competing priorities
Desirable Skills :
- Previous work experience in the financial sector (insurance or benefits industry).
- Knowledgeable or at least have the basic concept of Data Visualization in any of the following tools : Tableau, PowerBI, QlikView / QlikSense
Big Data Engineer for AI Training
Are you an experienced software engineer who would like to lend your coding expertise to train AI models?. PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. W...
Data Engineer
The incumbent will utilize software like MS Azure Data Studio, PostgreSQL, MS Azure Data Factory and SPSS to support the Faculty’s data infrastructure. Database, Data Analyst, Information Systems, Data Management, Data Warehouse, Technology, Data. Demonstrate expertise in data modelling and query pe...
data analytics manager
Plan and control budget and expenditures.Establish and implement policies and procedures for information systems.Authorize the development of specifications for products or services.Meet with clients to discuss system requirements, specifications, costs and timelines.Lead and co-ordinate teams of in...
Data Engineer
Manage timelines/deliverables within the team towards the successful delivery of projects.Design software solutions by interacting with portfolio managers, traders, operations staff and peers to understand requirements.Develop solutions that are in line with client's technology biases, deliver effic...
Data Engineer
The Data Engineer should have extensive experience working with very large data sets from the insurance industry and knowledge of building programs/mappings that leverage the Azure and Databricks platforms and Data warehouses. Strong preference will be given to Databricks Certified Data Engineer Ass...
Industrial Data Management Engineer
Build and maintain up to date the Industrial ERP data, including the Bill of Material Master data, the logistic flows, the Configuration Management data, etc. The Industrial data engineer is responsible to:. Ensure the data migration and pilot the data rework. Pilot the implementation of the industr...
Data Engineer
As data becomes increasingly central to enhancing patient outcomes, we are looking for a talented Data Engineer to join us on a part-time contract basis. As a full - time Data Engineer within our IT department, you will work closely with our Reporting and Analytics team. Facilitate the democratizati...
DevOps Support Engineer (Azure)
Work closely with customers, engineering team, management team, and sales team as a point of contact for client issues. ...
Lead Data Engineer
Active Learning, Agile Methodology, Amazon Redshift, Apache Hadoop, Apache Spark, Application Integrations, AWS Cloud Computing, Data Pipelines, Data Science, Detail-Oriented, Emerging Technologies, Enterprise Application Delivery, Group Problem Solving, Kotlin Programming Language, Machine Learning...
Azure ML engineer
We are looking for a talented and highly effective Sr.Developer to join our development and support team.We are currently supporting, enhancing and maintaining the statewide SNAP,'TANF Eligibility Determination and ancillary application registration system.The enhancements Include use of latest tech...