Senior Data Engineer - Azure DatabricksLondon (Hybrid – 3 days per week in office)We’re working with a fast-growing technology organisation building a modern, scalable data platform from the ground up. This is an exciting opportunity for a Senior Data Engineer who wants to shape architecture, drive best practice, and build secure, enterprise-grade data systems in a high-impact environment.This role would suit someone who enjoys ownership, thrives in collaborative environments, and is motivated by building robust, future-proof data solutions at scale.The RoleAs Senior Data Engineer, you will design, implement, and secure a modern data platform (Databricks + pipelines + governance), establishing repeatable processes to ensure data is accurate, accessible, compliant, and cost-effective.You’ll work closely with data scientists, analysts, and stakeholders to create scalable, secure, and high-performing data infrastructure.Key ResponsibilitiesArchitect and build end-to-end data pipelines, data lakes, and data warehouses on Azure DatabricksIntegrate with ETL/ELT tools and Azure cloud servicesEstablish best practice for data modelling, QA, versioning, and orchestration (dbt, Airflow, Unity Catalog)Implement security-first data architecture (RBAC, encryption, masking, GDPR/SOC2 standards)Define governance frameworks, SLAs, and data quality standardsOptimise performance, scalability, and cost-efficiency across large-scale and real-time workloadsAutomate monitoring, alerting, and recovery processesEmbed DevOps practices for data including CI/CD and Infrastructure as CodeWhat We’re Looking For5+ years’ experience in Data Engineering, including 2+ years at Senior levelProven experience building production-grade data platforms from scratchStrong Azure Databricks, Spark and Python expertiseExperience with MySQL, PostgreSQL and MSSQLExperience in data-intensive, agile environmentsStrong troubleshooting, optimisation, and governance experienceAbility to build basic reporting/PoC outputs where requiredSecurity-first mindset and strong understanding of compliance standardsYou’ll likely thrive here if you:Enjoy leading initiatives in ambiguous, evolving environmentsTake ownership of end-to-end deliveryHave a proactive, risk-aware approach to data securityStay curious about emerging technologies