Azure Data Architect

Requirements:

• 12 to 15 years of Total Experience and 8+ years of experience in Architecting / designing and implementing ETL based solutions / applications and understanding of cloud service and deployment model.

• First-hand experience and strong technical knowledge in ETL, software design and development and implementation using ADF, ADB, SQL Server, Python, Spark

• Very Good experience in development of ETL Jobs and Managing ADF Jobs, Data Bricks Pipelines and Azure servers.

• Ability to translate business requirements into fully functioning ETL workflows.

• Perform data analysis, data modelling, data migration, performance-tuning & change control.

• Experience in UNIX shell scripting.

• Experience in managing data lineage and performing impact analysis - Experience in designing and implementing data stores and data marts.

• Experience using scheduling tools like Control M, Autosys etc.
  Experience in Analysing ETL requirements, designing and implementing complex ETL Jobs, and maintaining ADF, ADB Pipelines and Data flows.

• Experience in designing and delivering complex large volume data warehouse applications using ADF and Data Bricks

• Organize data at different aggregation levels hierarchies Write complex data transformation logic.

• Experience in designing the data integration jobs fault tolerant and scalable.

• Cloud experience is necessary (Azure)

• Experience in implementing Application security, Data Security (Data Anonymization) requirements.

• Experience in CICD Implementations, knowledge of GitHub, Jira and TFS

• Experience with Agile development methodology.

• Excellent problem solving/analytical skills and complex troubleshooting methods.

• Effective communication and Presentation skills.

• Certified in Azure Architecture

Key Responsibilities:

• Architecting, Planning and Implementation of end- to- end Data Warehouse and Business Intelligence systems utilizing best practices from Data Architecture, Data Integration and Data Management areas.

• Establish data standards and templates to improve quality and integrity of data.

• Implementing application security and Data Security and Anonymization requirements as per specifications

• Integration of diverse data sources with the EDW using ADF and ADB

• Developing Analysis Model for the business subject areas. Identify and understand Source Data Systems. Map Source System Data to EDW Data Model.

• Performance Tuning of the ETL Load Jobs

• Prepare the Design for data pipelines and data flow for large volume of data.

• Create, Configure and Manage Azure Instances, Resources and Servers. Provide Inputs on Capacity Planning.

• Troubleshoot ETL Application issues to determine root causes and fix issues in Prod / QA / UAT / Parallel and Dev

• Review ETL Framework and provide inputs for system improvement ideas and work with team to implement the best approach.

• Provide leadership to the team in implementing technical solution.

• Follow Agile Process Methodology to ensure effective communication and faster development cycles. Co-Ordinate with stakeholders (Scrum Master, Architect, PM Etc) in agile ceremonies and provide required updates.