We are seeking a highly skilled Senior DevOps Engineer with extensive experience in Azure, Terraform, Databricks, and DevOps practices.
This role involves designing, implementing, and managing scalable cloud infrastructure, automating deployments, and ensuring compliance with security standards.
The ideal candidate will have strong expertise in cloud architecture, CI / CD pipelines, and infrastructure as code (IaC).
Key Responsibilities
- Design and implement scalable and secure cloud infrastructure using Azure services.
- Monitor and troubleshoot cloud infrastructure and services for performance and reliability.
- Develop and manage Databricks environments for data processing and analytics.
- Implement ETL pipelines using Databricks and integrate with other data sources.
- Optimize Databricks performance and cost efficiency.
- Write and maintain Terraform scripts to automate infrastructure provisioning.
- Implement Infrastructure as Code (IaC) practices for consistency and reproducibility.
- Collaborate with development teams to integrate Terraform into CI / CD pipelines.
- Implement and manage CI / CD pipelines using tools like Jenkins, GitHub Actions, or Azure DevOps.
- Ensure security and compliance in DevOps workflows.
- Implement and manage Azure Networking (VNETs, VPNs, ExpressRoute).
- Manage Azure Active Directory and role-based access control (RBAC).
- Document infrastructure designs, configurations, and procedures.
- Provide training and support to team members on cloud technologies and best practices.
Required Qualifications
10+ years of experience in cloud engineering with a focus on Azure.Proven experience with Databricks and data engineering.Strong knowledge of Terraform and IaC principles.Hands-on experience with DevOps tools and practices.Experience with containerization and orchestration tools (Docker, Kubernetes).Proficiency in scripting languages (Python, PowerShell, or Bash).Solid understanding of networking concepts and cloud security best practices.Excellent problem-solving skills and ability to work in a fast-paced environment.Preferred Qualifications
Familiarity with Big Data technologies and frameworks.#J-18808-Ljbffr