- Requirements: 6+ years of data engineering experience, with at least the last three years on Databricks in production.
- Deep hands-on experience with medallion / Lakehouse architecture, Delta Lake, Unity Catalog, Lakeflow Declarative Pipelines and Databricks Asset Bundles.
- Strong python, PySpark and SQL, comfortable diagnosing performance issues on large workloads through Spark UI and Photon.
- Real production experience with streaming ingestion (Kafka Structured Streaming, Auto Loader) and CDC patterns.
- Experience implementing data quality at scale (Great Expectations or equivalent), plus lineage, cataloguing and access control.
- CI/CD on data platforms through Azure DevOps or GitHub Actions, with infrastructure as code (Terraform or equivalent).
- Fluent working English.
#J-18808-Ljbffr
We are looking to fill the Senior Data Engineer position at Y-Axis in Berlin, Germany.
The advertised compensation is 90.000 - 150.000.
We aim to respond to suitable candidates as soon as possible.