Data Engineer

E-Solutions
Remote, BC
$56 an hour (estimated)
Remote
Full-time

Role : Data Engineer

Location : Remote (PST working hours)

Term : Long Term Contract

Data Engineer Jd New

  • years of experience
  • Pyspark knowledge
  • Should be able to write python code in Azure Synapse Notebook.
  • Good understanding of Azure Synapse end-to-end.
  • Should be able to work with streaming data . (possibly from Event hubs )
  • Should have experience in handing large volume of data (possibly in s of GB).
  • Should be able to debug and fine tune the jobs / notebook for optimum memory consumption and processing.
  • Should have knowledge of Data warehousing, data managemen t for efficient data handling.
  • Should have good knowledge data modeling & data engineering work
  • Experience working with large data sets using SQL / Azure Data Lake / PySpark / ADF / Synapse, etc., to derive actionable insights is highly desirable.
  • Kusto is nice to have.
  • Microsoft ecosystem knowledge is preferred.
  • They should be productive soonest possible post joining.
  • 30+ days ago
Related jobs
Promoted
ODAIA
Canada

Reporting to the Director of Data Management & Engineering the Data Engineer is experienced and passionate about building creative and novel data solutions. Develop and maintain scalable big data solutions, and data pipelines to support data transformation and analytics initiatives. We are passionat...

Parent Organization
Richmond, British Columbia
Remote

Workingexperience with big data technology such as Airflow Hive andSnowflake. ...

Datavant
Canada
Remote

Datavant is a data logistics company for healthcare whose products and solutions enable organizations to move and connect data securely. We are a data logistics company for healthcare whose products and solutions enable organizations to move and connect data securely. Datavant has a network of netwo...

Partech
Remote Canada
Remote

Punchh is looking for a Senior Big Data Engineer that will play a critical role in shaping Punchh’s data innovations. Work with large data sets and implement sophisticated data pipelines with both structured and structured data. Big Data engineering professional, developing scalable big data solutio...

circle
Burnaby, British Columbia

Working closely across groups, such as the product, engineering, data science, and external partners for data modeling, general management of data life cycle, data governance and processes for meeting regulatory and legal requirements. Collaborating with business teams on the design, deployment and ...

TELUS
Vancouver, British Columbia

The Data Strategy & Enablement team is on a continuous journey towards helping TELUS become a world-class leader in data solutions, doing so by delivering data analytics capabilities built upon unified scalable platforms, advanced AI tooling, high quality data, and a data-product and data platform o...

CB Canada
North Vancouver, British Columbia

Data Engineer (Python or Scala). On behalf of our client, Procom Consultants Group is currently looking for a Data Engineer (Python or Scala). This contract Data Engineer will be responsible for automating the fetching of claims documents from OpenText Content Server and using an open source tool te...

Calix
Remote - Canada
Remote

Good Experience with load balancers, WebSockets and similar technologies at different layers for efficient data abstraction and transfer for large scale data connections / large flow of data. Strong background in transactional databases and good understanding and experience with no-SQL datastores an...

Aritzia
Vancouver, British Columbia

Proven skills, education, and/or applicable certifications in: Experience creating custom data visualizations and data experiences using modern tools (Tableau, Looker, Power BI)Ability to lead the design process from ideation to polished design, using sketches, wireframes, UX scenarios and mockups t...

Fraser Health
Surrey, British Columbia

A Senior Data Engineer leads the team across our data strategy, analysis, data integration, and data management. Supporting the Vision, Values, Purpose and Commitments of Fraser Health including service delivery that is centered around patients/clients/residents and families: The Senior Data Enginee...