Data Engineer

Direct message the job poster from Altimetrik

Overview

Design, develop, and maintain software solutions using Python.

Responsibilities

• Design, develop, and maintain software solutions using Python .
• Develop Python and pyspark programs for data analysis. Develop a Custom Framework for generating rules (a rules engine).
• Develop Python code to gather data from HBase and design solutions to implement using PySpark. Utilize Apache Spark DataFrames / RDDs for business transformations and Hive Context for read / write operations.
• Develop back-end services, APIs, and integrate databases.
• Optimize applications for performance, security, and maintainability.
• Troubleshoot and resolve software defects and issues.

Required Skills

Seniority level

Employment type

Job function

Industries

#J-18808-Ljbffr