Berlin
Temporary
Not specified
Mid-Senior level
Salary
Sponsorship
15% more than your current base salary
SAVE
APPLY
👥
45
Clicked Apply

Job Description

Data Engineer - Berlin - Spark/PythonLocation: Berlin, HybridAvailability: 40 hours per weekAbout the RoleOur client is seeking an experienced Data Engineer to design, build, and maintain reliable data pipelines that support reporting, analytics, and business decision-making across their tools and platforms. This position blends hands-on data engineering with close collaboration with stakeholders, with a strong emphasis on SQL, data modelling, and data accuracy.Key Responsibilities* Design, build, and optimise scalable batch data pipelines for product and analytics use cases* Develop efficient Spark SQL transformations on large-scale datasets* Use Python for data processing, workflow orchestration, and automation* Design and maintain robust data models (facts, dimensions, aggregates) with clearly defined grain and metrics* Take ownership of data quality and accuracy, including:o Ensuring metric consistency and reliabilityo Managing edge cases such as late-arriving data, duplicates, and adjustmentso Reconciling outputs with source systems and downstream requirements* Implement data validation, quality checks, and reconciliation processes* Collaborate with business stakeholders to gather requirements, define metrics, and deliver trusted data assets* Partner with platform and infrastructure teams on pipeline standards, performance optimisation, and best practicesRequired Experience & Skills* 5+ years' experience in data engineering or a related field* Strong Spark SQL expertise for large-scale data transformation* Practical Python experience for data processing and pipeline development* Solid understanding of dimensional data modeling concepts (facts, dimensions, grain, slowly changing dimensions, etc.)* Proven experience building and maintaining batch data pipelines in production environments* Strong focus on data quality, accuracy, and metric integrity for analytics and reporting* Ability to communicate effectively with non-technical stakeholders and translate business requirements into data solutions* Excellent problem-solving skills and attention to detail If this is of interest, please forward your CV to taylor.lewis@darwinrecruitment.comDarwin Recruitment is acting as an Employment Business in relation to this vacancy.

Responsibilities

Job Requirements

Apply now
Read Full Description

More job openings