Data Engineer

Job Summary

We are looking for an Azure Databricks Administrator with hands-on experience in managing Databricks environments and working with Azure data services. The role involves setup, monitoring, and supporting data platforms while working closely with business teams.

Key Responsibilities

• Manage and maintain Azure Databricks workspaces, notebooks, and jobs
• Create workspaces and provide user access
• Configure and manage clusters (all-purpose, job, high concurrency)
• Monitor cluster performance and optimize costs
• Ensure data security and access control
• Integrate Databricks with:
• Azure Data Lake (ADLS)
• Azure Data Factory (ADF)
• Azure Synapse
• Set up CI/CD pipelines using Azure DevOps
• Support basic Terraform-based deployments
• Monitor workloads and troubleshoot issues

Required Ski...