Data Engineer
Role : Data Engineer
Location : Remote (PST working hours)
Term : Long Term Contract
Data Engineer Jd New
- years of experience
- Pyspark knowledge
- Should be able to write python code in Azure Synapse Notebook.
- Good understanding of Azure Synapse end-to-end.
- Should be able to work with streaming data . (possibly from Event hubs )
- Should have experience in handing large volume of data (possibly in s of GB).
- Should be able to debug and fine tune the jobs / notebook for optimum memory consumption and processing.
- Should have knowledge of Data warehousing, data managemen t for efficient data handling.
- Should have good knowledge data modeling & data engineering work
- Experience working with large data sets using SQL / Azure Data Lake / PySpark / ADF / Synapse, etc., to derive actionable insights is highly desirable.
- Kusto is nice to have.
- Microsoft ecosystem knowledge is preferred.
- They should be productive soonest possible post joining.
Senior Data Engineer/Admin - (Research Institute) | Full-Time
The data engineer is responsible for architecting, implementing, and maintaining compute frameworks, analysis tooling, and/or model implementations used or created by the Data Science team to support the management and analysis of clinical and administrative data at the McGill University Health Cent...
Forcepoint DLP (Data Loss Prevention) Engineer
Forcepoint DLP (Data Loss Prevention) Engineer. CASB, Data Classification, Data Discovery, encryption, etc. Forcepoint DLP Engineer or Forcepoint NGFW Engineer). This qualified individual will provide engineering, installation, configuration and integration of Forcepoint products. ...
Senior Software Engineer - Data
Marqeta is looking for a Senior Software Engineer to join our Data Parser team. As a Senior Software Engineer, you will work on building a scalable and efficient data processing service that enables cross-product solutions. Contribute to the architecture design while taking into account current data...
Staff Data Platform Security Engineer
Partner closely with teams and organizations across Engineering, Legal, and Product to embed sound technical data security and privacy practices in everything we ship and help uncover risks before they become issues. Database principles including familiarity with SQL, noSQL, data warehousing, and DB...
Senior Data Engineer
Engineer and enhance data pipelines, ETL processes, and data cleaning mechanisms to support a comprehensive cybersecurity data analysis system. We are on the lookout for a talented Senior Data Engineer to contribute significantly to our advanced data collection, processing, and analysis system which...
Data Engineer
Engineering background (data pipeline, data ingestion, data warehousing, data analytics). Software Engineer (Back-end/ Data). The Select Group is seeking a Software Engineer (Back-end/Data) for their top telecommunication client. For this role, the Engineer will join a team that manages the data lak...
Senior Data Engineer (Informatica IICS) [BHJOB13022_13268]
This role is responsible for the design and development of the Enterprise Analytics Data Warehouse and reporting environment, taking business reporting requirements and working with the data architect, platform engineering, DBA, and data governance teams to design ingestion mechanisms, process and t...
Data Engineer
Dropbox is looking for a Data Engineer to join our Finance Data Engineering (FDE) team to build out next generation Financial data pipelines that power crucial business decisions throughout the organization including metrics (ARR, Churn) that are reported externally to Wall St. As a data engineer, y...
Professional Services Engineers – Mobile Data Network Calgary
Field Support / PS Engineer, Customer Service Engineer. They are looking for a Professional Services Engineer with about 5 yrs experience. The Professional Services Engineer is a key role in the Professional Services (PS). ...
Senior Software Engineer, Data - Flights (Virtual Interlining)
Created product data pipelines from scratch, owning the data dictionaries, data quality checks, and dataflows. Due to the nature of the problem we use a lot of data, and are looking to hire a Senior Software Engineer who has a track record of owning and solving ambiguous problems in a data driven wa...