Business Intelligence 7221-2112

HM Note : This hybrid role isthree (3) days in office and candidates need to include threereferences with theresume.

Description :

GeneralResponsibilities

• Designdevelop and implement ingestion framework from Oracle source toAzure Data Lake initial load and incremental ETL. Used toolsare :
• Azure DataFactory (expert knowledge) to maintain pipeline from Oracle toAzure Data Lake
• AzureSynapse to build stored procedures and read data from datalake
• Review therequirements database tables and database relationships Identifygaps and inefficiencies in current production reporting environmentand provide recommendations address them in the newplatform.
• Continue toevolve and design ingesting framework andCDC
• Prepare designartifacts
• Analysis ofdata physical model mapping from data source to reportingdestination.
• Understandthe requirements. Recommend changes to the Physicalmodel.
• Develop thescripts of physical model and createDB.
• Access Oracle DBenvironments and nbsp;use and nbsp; SSISSQL Server and other development andnbsp; tools for developingsolution.
• Proactivelycommunicate with business on any changes required to conceptuallogical and Physical models communicate and review dependencies andrisks.
• Development ofETL and nbsp; strategyand andnbsp; solution based on different set ofmodules
• Understand theTables andRelationships.
• Createlow level design documents and unit testcases.
• Create theworkflows of packagedesign
• Development andtesting of data with Incremental and FullLoad.
• Develop highquality ETLmappings / scripts / jobs
• ETLdata from Applications to DataWarehouse
• ETL datafrom Data Warehouse to DataMart
• Perform unittests.
• PerformanceReview data Consistencychecks
• Troubleshootperformance issues ETL Load issues log activity for each Individualpackage andtransformation.
• ReviewPerformance of ETLOverall.
• End to endIntegrated testing for Full Load and IncrementalLoad
• Plan for Go LiveProductionDeployment.
• Createproduction deploymentsteps.
• Configureparameters scripts for go live. Test and review theinstructions.
• Createrelease documents and help build and deploy code acrossservers.
• Go LiveSupport and Review after GoLive.
• Review existingETL process tools and provide recommendation on improvingperformance and reduce ETLtimelines.
• ReviewInfrastructure and any pain points for overall processimprovement
• KnowledgeTransfer to Ministry staff development of documentation on the workcompleted.
• Documentshare and work on the ETL end to end working knowledgeTroubleshooting steps configuration and scriptsreview.
• Transferdocuments scripts and review ofdocuments.

Skills

Experienceand Skill SetRequirements

Experience :

• Experienceof 7 years of working with and nbsp; SQLServer ADF and TSQL Development andnbsp; (MustHave)
• Experienceworking with building Databases Data Warehouse and Data Mart andworking with delta / incremental and full loads andnbsp; (MustHave)
• Experiencewith any ETL tools such as SQL Server ADF Cloud tools andnbsp; (MustHave)
• Experienceworking with MSSQL Sever on premise and within Azure Environmentand nbsp; (MustHave)
• Experience onData modeling and tools e.g. SAP PowerDesigner
• Experiencewith snowflake and star schema model. Experience in designing datawarehouse solutions using slowly changingdimensions.
• Experienceworking with SQL Server SSIS and other ETL tools solid knowledgeand experience with SQL other RDBMS (SQL ServerSSIS)
• Understandingdata warehouse architecture with a data vault dimensional data andfact model.
• Analyzedesign develop test and document ETL programs from detailed andhighlevel specifications and assist introubleshooting.
• UtilizeSQL to perform tasks other than data transformation (DDL complexqueries)
• Goodknowledge of database performance optimizationtechniques
• Ability toassist in the requirements analysis and subsequentdevelopments
• Abilityto conduct unit tests and assist in test preparations to ensuredata integrity
• Workclosely with Designers Business Analysts and otherDevelopers
• Liaise withProject Managers Quality Assurance Analysts and BusinessIntelligenceConsultants
• Design andimplement technical enhancements of Data Warehouse asrequired.

Skills :

• 7years in ETL tools such as Microsoft SSIS stored procedures andnbsp; (MustHave)
• 2 Azure DataLake and Data Warehouse and building Azure Data Factorypipelines and nbsp;(MustHave)
• 2 yearsPython and nbsp;(nice tohave)
• Databricks
• Synapse(nice to have)
• SQLServer
• Oracle
• Abilityto present technical requirements to thebusiness

EvaluationCriteria

DesignDocumentation and Analysis Skills (45points)

• Demonstratedexperience in creating both Functional Design Documents (FDD) andamp; Detailed Design Documents(DDD).
• Experience inFitGap analysis system use case reviews requirements reviews codingexercises andreviews.
• Experience inthe development and maintaining a plan to address contractdeliverables through the identification of significant milestonesand expected results with weekly statusreporting.
• Work withthe Client and amp; Developer(s) assigned to refine / confirmBusinessRequirements
• Participatein defect fixing testing support and development activities for ETLtool. Assist with defect fixing and testing support for Power BIreports.
• Analyze andnbsp;and document solution complexity and interdependencies byfunction including providing support for datavalidation.

DevelopmentDatabase and ETL experience (45points)

• Demonstratedexperience in Microsoft specific software development and a numberof years of practical experience (minimum 7years)
• Provenexperience in developing in AzureDevOps
• Experience inapplication mapping to populate data vault and dimensional datamartschemas
• Demonstratedexperience in Extract Transform and amp; Load and Extract Load andand nbsp;Transforms and nbsp;software development and a number ofyears of practical experience (minimum 7years)
• Experience inproviding ongoing support on Azure pipeline / configuration and SSISandnbsp;development
• Experiencebuilding data ingesting and change data capture using Golden Gate(an asset but notmandatory)
• Assist inthe development of the predefined and adhoc reports and meet thecoding and accessibilityrequirements.
• Demonstratedexperience with Oracle and Microsoftinterfaces
• Proficientin SQL and AzureDevOps
• Implementinglogical and physical datamodels

KnowledgeTransfer (10points)

TheDeveloper must have previous work experience in conductingKnowledge Transfer and training sessions ensuring the resourceswill receive the required knowledge to support the system.

Theresource must develop learning activities using reviewwatchdomethodology and amp; demonstrate the ability to prepare andpresent.

• Developmentof documentation and materials as part of a review and knowledgetransfer to othermembers
• Developmentand facilitation of classroom based or virtual instructor demo ledsessions forDevelopers
• Monitoridentified milestones and submission of status reports to ensureKnowledge Transfer is fullycompleted
30+ days ago