Databricks Engineer - £400PD - Remote

Databricks Engineer - £400PD - RemoteAbout the RoleWe are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven decision making across the business.Key ResponsibilitiesDesign, develop, and maintainETL/ELTpipelines using Azure Databricks, PySpark, and Delta Lake.Build and optimise data lakehouse architectures on Azure Data Lake Storage(ADLS).Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and DatabricksworkflowsImplement best practices for data governance, security, and quality across all pipelines.Collaborate with data scientists, analysts, and cross-functional teams to deliver reliable, production-grade data models.Monitor and tune pipeline performance to ensure efficiency, reliability, and cost optimisation.Participate in CI/CD processes and infrastructure-as-code solutions using tools like Terraform, GitHub Actions, or Azure DevOpsRequired Skills & Experience3+ years' experience as a Data Engineer working in Azure environments.Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling).Solid knowledge of Azure cloud services including:Azure Data Lake StorageAzure Data FactoryAzure Synapse / SQL PoolsAzure Key VaultStrong programming skills in Python and SQL.Experience building scalable, production-grade data pipelines.Understanding of data modelling, data warehousing concepts, and distributed computing.Familiarity with CI/CD, version control, and DevOps practices.Nice-to-HaveExperience with streaming technologies (e.g., Spark Structured Streaming, Event Hub, Kafka).Knowledge of MLflow, Unity Catalog, or advanced Databricks features.Exposure to Terraform or other IaC tools.Experience working in Agile/Scrum environments.To apply for this role please submit your CV or contact Dillon Blackburn on or at.Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment. We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven decision making across the business. Design, develop, and maintainETL/ELTpipelines using Azure Databricks, PySpark, and Delta Lake. Design, develop, and maintainETL/ELTpipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage(ADLS). Build and optimise data lakehouse architectures on Azure Data Lake Storage(ADLS). Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricksworkflows Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricksworkflows Implement best practices for data governance, security, and quality across all pipelines. Implement best practices for data governance, security, and quality across all pipelines. Collaborate with data scientists, analysts, and cross-functional teams to deliver reliable, production-grade data models. Collaborate with data scientists, analysts, and cross-functional teams to deliver reliable, production-grade data models. Monitor and tune pipeline performance to ensure efficiency, reliability, and cost optimisation. Monitor and tune pipeline performance to ensure efficiency, reliability, and cost optimisation. Participate in CI/CD processes and infrastructure-as-code solutions using tools like Terraform, GitHub Actions, or Azure DevOps Participate in CI/CD processes and infrastructure-as-code solutions using tools like Terraform, GitHub Actions, or Azure DevOps 3+ years' experience as a Data Engineer working in Azure environments. 3+ years' experience as a Data Engineer working in Azure environments. Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Solid knowledge of Azure cloud services including:Azure Data Lake StorageAzure Data FactoryAzure Synapse / SQL PoolsAzure Key Vault Solid knowledge of Azure cloud services including: Azure Data Lake Storage Azure Data Lake Storage Azure Data Factory Azure Data Factory Azure Synapse / SQL Pools Azure Synapse / SQL Pools Azure Key Vault Azure Key Vault Strong programming skills in Python and SQL. Strong programming skills in Python and SQL. Experience building scalable, production-grade data pipelines. Experience building scalable, production-grade data pipelines. Understanding of data modelling, data warehousing concepts, and distributed computing. Understanding of data modelling, data warehousing concepts, and distributed computing. Familiarity with CI/CD, version control, and DevOps practices. Familiarity with CI/CD, version control, and DevOps practices. Experience with streaming technologies (e.g., Spark Structured Streaming, Event Hub, Kafka). Experience with streaming technologies (e.g., Spark Structured Streaming, Event Hub, Kafka). Knowledge of MLflow, Unity Catalog, or advanced Databricks features. Knowledge of MLflow, Unity Catalog, or advanced Databricks features. Exposure to Terraform or other IaC tools. Exposure to Terraform or other IaC tools. Experience working in Agile/Scrum environments. Experience working in Agile/Scrum environments. To apply for this role please submit your CV or contact Dillon Blackburn on or at. Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment.