Sr Cloud Data Engineer- Assistant Vice President

Responsibilities

• Recognize the current application infrastructure and suggest new concepts to improve performance.
• Document the best practices and strategies associated with application deployment and infrastructure support.
• Produce reusable, efficient, and scalable programs, and also cost-effective migration strategies
• Develop Data Ingestion and Engineering in Databricks that includes Data Sync, Auto loader, DLT framework
• Develop application using different AWS services, including S3, EC2, API, RDS, Kinesis / Kafka and Lambda
• Work jointly with the IT team and other departments to migrate data engineering and ML applications to Databricks / AWS
• Work with office and architecture and platform engineering teams to drive end to end usecases
• Design Data Pipelines
• fortable to work on tight timelines, when required.

Skill Sets Required

• Good decision-making and problem solving skills
• Strong knowledge on Data Warehousing and Data Lake concepts
• Solid understanding of Databricks fundamentals / architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse).
• Strong Knowledge on medallion architecture, Autoloader, DLT and Unity Catalog within Databricks.
• Experience in migrating data from on-prem Hadoop to Databricks / AWS
• Understanding of core AWS services, uses, and AWS architecture best practices
• Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.
• Solid knowledge on Airflow
• Solid knowledge on CI / CD pipeline in AWS technologies
• Application migration of RDBMS, java / python applications, model code, elastic etc.
• Solid programming background on sql, python
• Experience with Docker and Kubernetes is a plus.

Additional requirements

This role may require occasional L4 production support and weekend release support.

Why this role is important to Us

Our technology function, Global Technology Services (GTS), is vital to State Street and is the key enabler for our business to deliver data and insights to our clients.

We're driving thepany's digital transformation and expanding business capabilities using industry best practices and advanced technologies such as cloud, artificial intelligence and robotics process automation.

We offer a collaborative environment where technology skills and innovation are valued in a global organization. We're looking for top technical talent to join our team and deliver creative technology solutions that help us be an end-to-end, next-generation financial servicespany.

Join us if you want to grow your technical skills, solve real problems and make your mark on our industry.

About State Street

What we do. State Street is one of the largest custodian banks, asset managers and asset intelligencepanies in the world.

From technology to product innovation we're making our mark on the financial services industry. For more than two centuries, we've been helping our clients safeguard and steward the investments of millions of people.

We provide investment servicing, data & analytics, investment research & trading and investment management to institutional clients.

Work, Live and Grow. We make all efforts to create a great work environment. Our benefits packages arepetitive andprehensive.

Details vary in locations, but you may expect generous medical care, insurance and savings plans among other perks. You'll have access to flexible Work Program to help you match your needs.

And our wealth of development programs and educational support will help you reach your full potential.

Inclusion, Diversity and Social Responsibility. We truly believe our employees' diverse backgrounds, experiences and perspective are a powerful contributor to creating an inclusive environment where everyone can thrive and reach their maximum potential while adding value to both our organization and our clients.

We warmly wee the candidates of diverse origin, background, ability, age, sexual orientation, gender identity and personality.

Another fundamental value at State Street is active engagement with ourmunities around the world, both as a partner and a leader.

You will have tools to help balance your professional and personal life, paid volunteer days, matching gift program and access to employee networks that help you stay connected to what matters to you.

State Street is an equal opportunity and affirmative action employer.

Discover more at StateStreet / careers

Job ID R-748788