Nearshore- Data Engineer (AWS- Snowflake Cortex AI) - KPG99 INC

Hope you are doing well!

Nearshore / Latin America or Canada

Senior Data Engineer (Cloud)

Top Must-haves: AWS / EKS ( Amazon Elastic Kubernetes Service) Spring Boot Micro Services

Communication skills must 9/10 in English

Need full updated Linkedin

Date of birth

3 references provided

Must have:

• Design and implement ingestion pipelines from multiple source systems into Snowflake using AWS services and Python.

• Build and optimize SQL-based transformation pipelines for free-form text cleansing, normalization, and deduplication.

• Implement Snowflake Cortex AI workflows for classification, extraction, and structured data generation.

• Develop robust prompt versioning, response parsing, validation, and fallback logic.

• Define, instrument, and track data and model quality KPIs, including precision, recall, coverage, drift, and error rates.

• Integrate Arize (or a comparable platform) for observability, monitoring, and root-cause analysis of model behavior.

• Support production rollout and operational readiness: deployment automation, runbooks, documentation, and handoff to internal teams.

Additional experience-

• 2+ years of hands-on experience developing and deploying Generative AI applications.

• Hands-on experience with Snowflake Cortex AI (or an equivalent production LLM platform).

• Experience building structured extraction pipelines from free-text inputs at scale (parsing, validation, deduplication, and quality controls).

• Experience implementing ML/LLM observability with Arize (or a comparable platform).

• Strong understanding of evaluation design, error analysis, and drift monitoring.

________________________________________

PREFERRED QUALIFICATIONS (NICE TO HAVE)

• Experience with human-in-the-loop workflows and taxonomy-driven classification systems.

• Experience with automated regression testing for prompts and LLM outputs (prompt evaluation frameworks).

Experience with large scale enterprise streaming services such as Kafka.

- Experience with Kubernetes and Docker containers or AWS Fargate.

- Experience implementing applications with both Windows and Linux server OS

- Experience with networking, security groups, or policy management in relation to Cloud resources across multiple operating systems, including UNIX, Linux, or Windows

- Advance CS degree.

PURPOSE:

As a Senior Cloud Data Engineer, you will work on the creation of Enterprise Data Platform for Client. As a valued member of Data Platform Architecture team, you will work on shaping and building new analytical solutions to deploy in support of our internal clients

You’ll help to create solutions to drive the next wave of innovation. You’ll recommend tools and capabilities based on your research of the current environment and knowledge of various on-premises, Cloud-based, and hybrid resources.

You’ll work with our engineering, architecture, and migration teams to inform strategy and architecture design. This is an opportunity to stay on top of the latest Cloud resources as you lead efforts to prototype using multiple techniques and new technologies. You’ll be able to broaden your skillset into areas like automation, scripting, and containerization while developing critical systems for several of our internal clients. Join our team as we transform the way we manage data and information by taking advantage of Cloud technology.

You will be a part of a ground-floor, hands-on, highly visible team which is positioned for growth and is highly collaborative and passionate about data.

We are looking for highly motivated AWS expert who excited about leveraging his skills and his strategic ideas to improve mission execution, who is passionate about creating an amazing user experience that delights end-users and makes their jobs easier.

This candidate builds fantastic relationships across all levels of the organization and is recognized as a problem solver who looks to elevate the work of everyone around them.

- Provides expert guidance to projects to ensure that their processes and deliverables align with the Client target state architecture.

- Design and develops enterprise data solutions based on architecture and standards leveraging leading architecture practices and advanced data technologies.

- Implement solutions for data migration, data delivery and ML pipelines.

- Implement Identity Access Management Roles and policies.

- Build resilient, reliable, performant and secure Data Platform and Applications.

- Work closely with application development and data engineer teams on day-to-day tasks along with project planning and implementation.

- Automate deployments of AWS services and BI Applications.

The ideal candidate demonstrates a commitment to Client core values: respect, integrity, humility, empathy, creativity, and fun.

TECHNICAL QUALIFICATIONS:

- 6+ years of experience within the field of application/platform engineering or related technical work including business intelligence, analytics.

- 4+ years of experience with AWS Senior Cloud Data Engineering, management, maintenance, or architecting, implementing best practices and industry standards.

- Experience with data warehousing platforms such as Snowflake, Redshift or similar.

- Strong knowledge and established experience with AWS services including but not limited to: S3, EC2, RDS, Lambda, Cloud Formation, Kinesis, Data Pipelines, EMR, Step Functions, VPC, IAM, and Security Groups.

- Experience with DB technologies (e.g., SQL, Python, PostgreSQL, AWS Aurora, AWS RDS, MongoDB, Redis).

- Experience with CI/CD tools, pipelines, and scripting for automation. (GitHub Actions, Jenkins, AWS Code Pipeline tools, Cloud formation and Terraform).

- High degree of knowledge in IAM Roles and Policies

- Strong knowledge configuring AWS cloud monitoring and alerts for cloud resource availability.

- Strong scripting experience using PowerShell and/or Python.

- High degree of knowledge in PaaS and SaaS application performance.

- Understand enterprise level application architecture diagrams and IT security requirements.

ADDITIONAL QUALIFICATIONS:

- Experience and comfort solving problems in an ambiguous environment where there is constant change

- Have the tenacity to thrive in a dynamic and fast-paced environment, inspire change, and collaborate with a variety of individuals and organizational partners

- Experience designing and building scalable and robust data pipelines to enable data-driven decisions for the business

- Effective problem solving and analytical skills. Ability to manage multiple projects and report simultaneously across different stakeholders

- Rigorous attention to detail and accuracy.

- Demonstrate d ability to troubleshoot technical problems and issues.

- Passionate about programming and learning new technologies.

- Experience planning and executing on-premises to AWS migrations

- BA or BS degree Computer Engineering, Computer Science, or related fields.

- Strong verbal and oral communication.

Thanks and Regards,

Mamta Giri | Sr. Technical Recruiter | KPG99, INC

Direct: 609-681-2599 |

https://www.linkedin.com/in/mamta-giri-usitrecruiter/

3240 E State St EXT, Hamilton, NJ 08619 | www.kpgtech.com