Data Architect with AWS Data Lake & Redshift

Data Architect with AWS Data Lake & Redshift – Contract

Responsibilities (Services):

The contractor will be expected to provide the following services and deliverables:

• As a member of the Applied Architecture group and working for the Data Hub project as a Data Architect, provides data architecture direction and delivers required architectural artifacts;
• Works closely with various internal business and technical stakeholders to gather their input on data concepts and solutions;
• Works with the Business areas to understand their needs and translate those needs into the appropriate conceptual, logical and physical data models
• Implement the Data Assets in the Hub Data Lake/Warehouse environment (S3, Redshift, Redshift Spectrum, Glue, Athena, EMR) and Informatica Data Management platform (BDM, BDQ, EDC, Axon);
• Develop data architectural standards, design patterns and schemas and conduct reviews to ensure their implementation.
• Review existing data architectures, provide feedback and work on relevant Reference Architectures.
• Delivers data architecture solutions for various aspects such as data versioning, data integrations etc.
• Contribute to the development of the overall architecture of the Data Hub platform and supporting technologies including data management platforms, information access, and health information applications.
• Provide subject matter expertise and technical leadership on the data architecture discipline. Ensures that data solutions exhibit high levels of performance, consistency, security, scalability, redundancy, maintainability, appropriate reusability and reliability;
• Ensures interoperability, performance and scalability, reliability and availability, data consistency, cost effectiveness, and technological risks are all addressed in the data architecture;
• Ensure solutions are documented and communicated effectively for their intended audiences;
• Support redesign and optimize Data Pipeline based on AWS Big Data technologies.
• Support Reference Implementation for optimized Data Pipeline
• Leverages Client strategic plan, goals, objectives, policies and procedures in creation of enterprise data architecture deliverables;

Overview



The Client’s Hub will implement an overarching architecture that holistically integrates, transforms and shares data. This architecture will address the Client’s current data management problems and has the following goals:

• Increase Client’s data handling capacity by orders of magnitude (provide more data to consumers)
• Make data accessible, shareable and understandable (democratize data and increase value extraction)
• Provide data security and data access auditing
• Support data governance (automated data quality, data transformation, data assets, etc.)
• Support standardization (data concepts, master data, aggregation, trending, etc.)
• Streamline and automate data flows and business processes
• Ability to adjust system capacity to meet variable demand
• Support remarkable customer experiences with Company data

The vision of a Data Hub is based on many years of Client experience combined with modern data management paradigms. Data Hub is an architectural ecosystem based on “Big Data”, Cloud and BI/Data visualization technologies that enables the Client to solidify its position in today’s data-first world.