Data Engineer

We are looking for an experienced Data Engineer for a client in the Netherlands. In this role, you will design, build, and maintain scalable data pipelines and a general-purpose data lake to support analytics and reporting. You will focus on creating reliable, automated data pipelines that improve data accessibility, quality, and performance. Working closely with the Learning & Insights team, you will develop data solutions that enable users to generate actionable insights while improving the efficiency and reliability of the data infrastructure. Your Job - Designing, building, and maintaining scalable data pipelines to support analytics and reporting - Developing automated and tested ETL processes to ensure reliable data delivery - Building and maintaining a general-purpose data lake that enables efficient data access and analysis - Implementing CI/CD workflows for data jobs using GitHub Actions - Setting up monitoring and alerting to ensure pipeline reliability and identify data quality issues - Implementing data quality checks at both row and aggregate levels - Applying data modelling techniques, including star schemas, dimensional modelling, and Slowly Changing Dimensions (SCD) - Working with different data processing approaches, including batch and streaming - Documenting data lineage and ensuring data governance principles are followed - Providing reliable datasets and query capabilities to support analytics and reporting - Collaborating with the Learning & Insights team to develop analytics features and dashboards - Improving testing, validation, and automation processes throughout the data development lifecycle Your Profile - At least 3 years of experience developing and maintaining data pipelines - Strong programming skills in Python and SQL - Hands-on experience with at least one major cloud platform, such as AWS, Azure, or Databricks - Experience with GitHub and GitHub Actions for version control and CI/CD - Strong understanding of ETL processes, data orchestration, and batch versus streaming processing - Knowledge of data modelling concepts, including star schemas, dimensional modelling, and SCD - Understanding of OLTP and OLAP concepts - Experience with unit, integration, and end-to-end testing - Knowledge of data quality, data lineage, and data governance principles - Experience monitoring and maintaining data pipelines in a production environment - Experience with AWS services such as Glue, Athena, DynamoDB, or Step Functions is a plus - Familiarity with PySpark or Golang is a plus - Experience with Infrastructure as Code, particularly AWS CloudFormation, is a plus - Knowledge of table formats such as Iceberg, Delta Lake, or Hudi is a plus - Familiarity with medallion architecture, schema evolution, data reprocessing, and distributed data processing is a plus - Experience improving development processes for data teams or building data solutions that generate actionable insights is a plus We Offer - Hybrid working environment - Salary up to €80K per year based on 36 hours - 22,5 vacation days Our Client Our client is looking to strengthen its data capabilities by building a reliable and scalable foundation for analytics and reporting. Within this environment, you will work on developing reusable data pipelines and improving the accessibility and quality of data. Your work will help reduce technical dependencies, streamline data processes, and enable teams to generate actionable insights more efficiently. You will play an important role in establishing a unified data infrastructure that supports current analytical needs and future growth. Interested? Apply directly or reach out to Ghazal. 📞 +31 6 15 36 67 90 ✉️ ghazalabuzneimah@yorteam.nl