Senior Data Engineer– ETL PySpark (7+ years) to develop and maintain data platforms and pipelines
s i systems • Victoria, CA
2 hours ago
Job type
- Full-time
Job description
Our client is seeking a Senior Software Developer – ETL PySpark (7+ years) to develop and maintain data platforms and pipelines using Python, PySpark, AWS EMR, and Oracle PL/SQL
Join a large-scale data platform initiative focused on delivering scalable public and private reporting products using modern technology stacks and Agile processes. This role supports the development, deployment, and maintenance of ETL pipelines and analytics products integrated with enterprise reporting environments. The position includes hands-on work across Python, PySpark, AWS, SQL, Oracle, and Apache Airflow within a remote delivery model.
Contract- 5 months March
Remote, Working Hours: EST
Must Haves
- 7+ years developing with Python and PySpark for large-scale data processing and analytics applications
- Hands-on development using AWS EMR, AWS Cloud, and Apache Airflow
- Advanced development using Oracle PL/SQL, AWS Redshift, SQL, and dimensional modeling
- Development in Linux/Unix environments using shell scripting and ETL technical documentation
Nice to Have
- Experience supporting advanced analytics, machine learning methods, and data visualization initiatives
- Experience supporting CI/CD pipeline jobs and peer code reviews
- Experience supporting Agile delivery environments
Responsibilities
- Develop and maintain data platform products and ETL pipelines
- Create and deploy code and script changes for product updates
- Execute unit and integration testing for application changes
- Support scheduled product releases by running scripts and updating configuration files
- Analyze and resolve software deficiencies and production issues
- Prepare deployment packages, release tickets, and technical documentation
- Support user inquiries, QA activities, and application administration tasks