Data Quality Developer

Talent Quanta TalentQuanta combines the agility of a boutique consultancy with the insight of a data-driven recruitment partner. Our approach blends deep sector knowledge with advanced research and network intelligence to deliver precise, high-impact results. THE MISSION On behalf of a confidential public sector institution in Luxembourg, we are looking for an experienced Data Quality Developer to join a small, focused team building a structured and sustainable data quality management framework. The institution manages several critical databases (case management, individuals, decisions, procedures, reference data, users, statistics) and wants to move from ad-hoc, partial data quality checks to a centralised, governed and automated control framework, built on Great Expectations and Apache Airflow. The Data Quality Developer will be responsible for the technical implementation and industrialisation of the platform, working in close collaboration with a Data Quality Analyst who defines and validates the underlying rules with the client’s data governance team.

Key Responsibilities

- Install, configure and administer the Great Expectations platform
- Configure connections to the client’s databases (PostgreSQL, DB2, and others as required)
- Develop the data quality rules validated by the client within Great Expectations
- Develop custom Expectations where standard functionality does not cover a specific need
- Organise controls into structured, maintainable Expectation Suites
- Implement Checkpoints and validation mechanisms
- Configure Data Docs and Great Expectations reporting
- Develop automation workflows (DAGs) under Apache Airflow
- Schedule and automate the execution of quality controls according to defined frequencies
- Integrate controls into existing data pipelines where necessary
- Implement logging, error handling and retry/recovery mechanisms
- Develop notification and results-distribution mechanisms
- Ensure version control (Git) of all developments
- Carry out unit, integration and validation testing, and fix issues identified during UAT
- Document all technical developments and participate in knowledge transfer to the client’s internal teams EngREQUIRED SKILLS & EXPERIENCE
- Strong Python development skills
- Hands-on experience implementing and administering Great Expectations (Expectation Suites, Checkpoints, Data Docs, custom Expectations)
- Solid experience with Apache Airflow (DAG development, orchestration and automation)
- Experience with ETL/ELT processes and data integration
- Proficiency with Git version control
- Experience writing unit, integration and validation tests
- Strong SQL skills and experience with relational databases (PostgreSQL, DB2)
- Experience building logging, monitoring and notification mechanisms
- Strong technical documentation skills NICE TO HAVE
- Experience with data governance platforms or data catalogue tools
- Experience in IT system migration or modernisation projects
- Exposure to Master Data Management (MDM) implementations
- Experience handling sensitive or confidential data, ideally in the public sector
- Knowledge of BI/data architectures (Data Warehouse, Data Lake, ETL/ELT) Apply Now Skillbourg