Azure Databricks/Presto SME

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best analytics global consulting team in the world.

We are seeking an experienced Data Engineer with expertise in Dataiku to join our data team. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines, data integration processes, and data infrastructure. You will collaborate closely with data scientists, analysts, and other stakeholders to ensure efficient data flow and support data-driven decision making across the organization.

Requirements

• 7-9 years hands-on experience with Workspace creation VNet injection/isolated
• Deployment model, storage account configuration, metastore configuration, cluster management, policies, code migration, user management, troubleshooting with other Azure PaaS resources, delta lake tables support, log analytics/monitoring.
• Awareness of Azure DataBricks workspace deployment, Identify prerequisites for launching an Azure Databricks workspace.
• Configure access control for workspace objects, such as notebooks and folders, Configure access control for clusters, pools, and jobs.
• Awareness of Azure DataBricks Security fundamentals
• Databricks File System and Hive Metastore and Presto concepts.
• Apply best practices to secure access to Azure data storage from Azure Databricks.
• Elementary level knowledge for AKS, helm and kubectl.
• Customer obsession, Ownership, Bias for Action
• Excellent remote collaboration skills
• Experience working in a matrix organization with diverse priorities
• Exceptional written and verbal communication skills along with collaboration and listening skills
• Ability to work with agile delivery methodologies
• Ability to ideate requirements & design iteratively with business partners without formal requirements documentation
• Excellent ability to document the roadmap for entire organization and have the patience to coach junior Azure Platform Admin’s to implement the best practices

Benefits

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.