Data Engineer
Altimetrik • mississauga, peel region, Canada
1 hour ago
Job type
- Full-time
Job description
Direct message the job poster from Altimetrik
Overview
Design, develop, and maintain software solutions using Python.
Responsibilities
- Design, develop, and maintain software solutions using Python .
- Develop Python and pyspark programs for data analysis. Develop a Custom Framework for generating rules (a rules engine).
- Develop Python code to gather data from HBase and design solutions to implement using PySpark. Utilize Apache Spark DataFrames/RDDs for business transformations and Hive Context for read/write operations.
- Develop back-end services, APIs, and integrate databases.
- Optimize applications for performance, security, and maintainability.
- Troubleshoot and resolve software defects and issues.
Required Skills
- Strong proficiency in Python and Spark .
Seniority level
- Mid-Senior level
Employment type
- Full-time
Job function
- Information Technology
Industries
- Software Development and Banking
#J-18808-Ljbffr