🇬🇧
Data Engineer (Analytics & Products)
Adevinta·kleinanzeigen.de GmbH Sucursal en España
Qué ofrecen
Contrato indefinido
Según la oferta.
Híbrido
Días de oficina y de casa — el reparto está en la oferta.
Qué piden
Trabajo en inglés
Se requiere inglés, según la oferta.
Estés cerca de kleinanzeigen.de GmbH Sucursal en para los días híbridos
No se menciona ninguna ayuda para la mudanza.
Extraído automáticamente de la oferta — lo que cuenta es el anuncio completo.
Añadida hace 1 mes
Requisitos
Data Modelling & dbt Development
Data Ingestion & Pipeline Engineering
Data Quality & Reliability
Cost Optimisation
Stakeholder Collaboration & Knowledge Sharing
AI-First Engineering
- Implement dbt models across the medallion architecture applying the right materialisation strategy for each layer and use case — incremental, full refresh or snapshots — with consistent naming conventions, YAML documentation, metadata tagging, unit tests to validate critical business logic, and reusable macros for common transformation and data replication patterns
- Build and refactor models for different business areas of the company, including for example marketing performance, product metrics, C2C transactions, monetisation, vibrancy, and trust & safety
- Author reusable macros and apply consistent naming conventions, YAML documentation, and metadata tagging (billed, retention, gdpr)
- Design data models that are homogeneous with the existing stack, built at the right grain for the use case, cost-effective to run, and self-discoverable without needing the author to explain them
- Perform cost-aware modelling: clustering strategies, warehouse sizing, incremental scan reduction, and pre-aggregation layers
Data Ingestion & Pipeline Engineering
- Build and maintain Airflow DAGs using Python operators, designing DAG topology deliberately by choosing execution patterns, dependency structures, and sensor logic that match the operational requirements of each pipeline
- Design sensor logic for pipeline dependencies, including intraday vs daily completeness checks and DST-aware temporal handling
- Operate Cosmos dbt task groups within Airflow, including DAG splitting, warehouse selection, and Cosmos version upgrades
- Integrate new data sources end-to-end by building reliable, fault-tolerant connections across heterogeneous endpoint types including REST APIs, event streams, database connectors and file-based sources, with error handling, retry logic, and security patterns that make each integration production-safe from day one, unit testing every operator and transformation component where possible, and defining SLAs and SLOs that set clear expectations on data freshness, completeness, and availability for downstream consumers
- Work with data in the right format for each layer: Avro for event-driven ingestion schemas, Parquet for efficient columnar storage, and Delta for ACID-compliant lakehouse tables with time travel and schema evolution
Data Quality & Reliability
- Write dbt tests (not_null, unique, accepted_values) and semantic row-count checks to catch data quality issues before they reach consumers
- Author unit tests for critical business logic using dbt's unit test framework
- Own data quality across the full lifecycle: design and maintain quality check pipelines combining dbt tests, semantic validation and custom logic, monitor pipeline health proactively before issues reach downstream consumers, diagnose and resolve root causes across schema drift, silent failures, duplicate data and idempotency issues, and plan and execute backfills safely with pre-validation, before and after checks and documented rollback criteria
- Apply governance standards consistently across every pipeline and data asset you own, ensuring compliance requirements, data classification, retention policies and ownership accountability are traceable and maintained as the platform evolves
- Contribute to the reliability of the platform beyond your own work, flagging systemic issues, improving shared patterns, and leaving every codebase and dataset in better shape than you found it
Cost Optimisation
- Identify and implement cost reduction opportunities: warehouse downsizing, incremental model rewrites, DAG consolidation, unused table deprecation
- Ensure governance rules for compliance and cost ownership are applied consistently across pipelines and data assets — including tagging standards (business_unit, business_area, team) in Airflow and dbt
- Evaluate and act on compute cost signals from Databricks query cost tables
Stakeholder Collaboration & Knowledge Sharing
- Partner with analysts, product managers and domain teams to translate business requirements into accurate, reusable data models, and enable them to build and own their own data assets through patterns, templates, PR reviews and pair programming
- Provide consultancy and training to product teams on data ingestion and transformation patterns
- Support analysts in adopting dbt for report-layer development, including onboarding, PR review, and pair programming
- Enable teams to build their own data products: provide patterns, templates, and consultancy so analysts and product teams can develop and own report-layer assets independently
- Define and document reusable metrics, dimensions and business logic in the semantic layer, and capture institutional knowledge including domain assumptions, architectural decisions and data lineage context so it lives in the codebase and not in people's heads
- Participate in cross-team alignment on data model standards, shared definitions and platform evolution, representing the data engineering perspective in decisions that affect multiple domains
AI-First Engineering
- Review and verify all AI-generated code before submitting for peer review — you own correctness, not the AI
- Maintain machine-readable context files (CLAUDE.md) in repositories you own, capturing architectural constraints, naming conventions, and domain-specific rules for AI agents
- Use AI tooling as a force multiplier: author intent specifications, verify AI-generated outputs with full ownership of correctness, contribute to shared skills and context files, and use automation to raise quality standards across the team
- Build and iterate on Claude agents for scoped engineering tasks (e.g. report-layer model extension, documentation generation, comparison notebooks)
- Orchestrate multi-agent workflows for complex tasks (large-scale migrations, documentation backfills, cross-domain refactors) while verifying outcomes
- Contribute to the team's AI Skill Library: dbt patterns, ingestion templates, data quality check agents
Beneficios
Life at Adevinta comes with its perks! Our Adevintans enjoy the following benefits:
On top of these, we also provide a range of locally relevant benefits. Wanna know more? Apply and ask our recruiters!
Adevinta is an equal opportunity employer and we value diversity. We do not discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, age, marital status or disability status.
- An attractive Base Salary
- Participation in our Short-Term Incentive plan (annual bonus)
- Work From Anywhere: Enjoy up to 20 days a year of working from anywhere! Maybe not from the moonwell why not! just make sure you have internet connection!
- A 24/7 Employee Assistance Program for you and your family, because we care
- Win together, lose together is one of our key behaviours. At Adevinta you will find a collaborative environment with an opportunity to explore your potential and grow
On top of these, we also provide a range of locally relevant benefits. Wanna know more? Apply and ask our recruiters!
Adevinta is an equal opportunity employer and we value diversity. We do not discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, age, marital status or disability status.
Oferta original
As a Data Engineer (Analytics & Products) at Kleinanzeigen, you start where the data need begins - not where the code does. You will work directly with product managers, analysts, and domain stakeholders to understand what decisions the data needs to support, how it will be consumed, and what already exists in the platform before writing a single line. From there, you design and build data assets that are homogeneous with the existing stack, cost-effective at scale, maintainable by the next engineer, and self-discoverable, so consumers can find, understand, and trust what you built without asking you.
You will own the full lifecycle: ingestion through Airflow DAGs, transformation across dbt stage, core, and report layers on Databricks, and the quality, documentation, and observability that make those assets production-grade. You stay current with Airflow and design DAG topology deliberately, knowing when to use dynamic task mapping, data-aware scheduling, the TaskFlow API, or a Cosmos dbt task group with Watcher mode for performance-critical pipelines. You understand Spark well enough to know why a dbt incremental model running in Databricks produces a full table scan instead of a partition filter push-down, how a poorly configured merge operation compounds into file fragmentation over time, and what to do about it, whether that means adjusting the incremental strategy, adding liquid clustering, running OPTIMIZE, or rethinking the model grain entirely. You write Python and shell scripts as naturally as SQL and follow engineering core principles: modularity, idempotency, testability, not because they are rules, but because they make your work last.
You operate in an AI-First engineering model: AI handles execution; you own intent, precision, and correctness. You use it to automate, to accelerate best practices, and to raise the quality bar across the team, not to ship faster with less judgment. You will collaborate closely with analysts, product managers, data platform engineers, and stakeholders across the company to ensure that the datasets we create and maintain in our data platform are reliable, trustworthy, and built to serve the decisions that matter.
You will own the full lifecycle: ingestion through Airflow DAGs, transformation across dbt stage, core, and report layers on Databricks, and the quality, documentation, and observability that make those assets production-grade. You stay current with Airflow and design DAG topology deliberately, knowing when to use dynamic task mapping, data-aware scheduling, the TaskFlow API, or a Cosmos dbt task group with Watcher mode for performance-critical pipelines. You understand Spark well enough to know why a dbt incremental model running in Databricks produces a full table scan instead of a partition filter push-down, how a poorly configured merge operation compounds into file fragmentation over time, and what to do about it, whether that means adjusting the incremental strategy, adding liquid clustering, running OPTIMIZE, or rethinking the model grain entirely. You write Python and shell scripts as naturally as SQL and follow engineering core principles: modularity, idempotency, testability, not because they are rules, but because they make your work last.
You operate in an AI-First engineering model: AI handles execution; you own intent, precision, and correctness. You use it to automate, to accelerate best practices, and to raise the quality bar across the team, not to ship faster with less judgment. You will collaborate closely with analysts, product managers, data platform engineers, and stakeholders across the company to ensure that the datasets we create and maintain in our data platform are reliable, trustworthy, and built to serve the decisions that matter.
Sobre la empresa
Adevinta
Online Marketplaces