Data Engineer | London | Remote-Friendly | £60,000 - £70,000We're working with BGTS on this exciting opportunity.Join a dynamic team as a Data Engineer, where you'll be instrumental in designing and building cutting-edge data pipelines using Azure Databricks, Python, and PySpark, driving the future of data architecture with a focus on real-time processing and Lakehouse solutions.The Role Design, build, and maintain high-quality, scalable data pipelines with Azure Databricks. Develop and manage Unity Catalog-based Lakehouse architecture for robust data solutions. Implement and optimize event-driven and real-time data processing. Build and manage CI/CD pipelines using Azure DevOps to automate data workflows. Champion data engineering best practices and provide technical guidance.What You'll Need Strong experience with Azure Databricks and cloud data platforms. Advanced proficiency in Python, PySpark, and SQL for data manipulation and analysis. Hands-on experience with structured streaming, event-driven systems, and Lakehouse architecture. Expertise in Azure DevOps and CI/CD pipelines for automated deployments. Knowledge of data modelling (dimensional/star schemas) and Agile methodologies.What's On Offer Opportunity to work with cutting-edge data technologies and cloud platforms. Hybrid work model offering flexibility and work-life balance. Engage in diverse projects, contributing to significant data initiatives. Collaborative environment focused on continuous learning and professional growth.Apply via Haystack today!