We can't find the internet
Attempting to reconnect
Something went wrong!
Attempting to reconnect
Senior Data Engineer / Databricks Developer
We are looking for at Senior Data Engineer / Databricks Developer for our client in the Pharma Industry
Project Description – DQX-Based Data Quality Monitoring
We are looking for an experienced senior data engineer / Databricks developer to support the design and implementation of a DQX-based Data Quality Monitoring capability.
The objective is to build a scalable solution that enables business users and data owners to monitor, understand, and act on data quality where it matters most. The solution should create a clear link between data input, data usage, and business-critical data quality rules, allowing data owners to define and enforce quality expectations across key data domains.
The capability should support business users in self-managing data quality oversight through dashboards, trending, and rule-based monitoring. This includes visibility into data quality performance over time, identification of recurring issues, and transparency on which data points are most critical based on documented business usage.
The initial scope will focus on selected Study Management data domain, starting with Study Personnel and Milestones, with the ambition to design the solution so it can scale to additional Clinical data areas over time.
The solution is expected to be built natively on Databricks, leveraging relevant data quality frameworks such as DQX, and should support a governed operating model where data quality rules are owned and endorsed by relevant data owners.
The expected outcome is a robust and scalable Data Quality Monitoring solution that improves transparency, strengthens data ownership, supports audit readiness, and enables proactive management of data quality issues before they create downstream impact.
Key Deliverables
The consultant is expected to contribute to:
- Design and implementation of a Databricks-native Data Quality Monitoring framework (DQX)
- Configuration and implementation of DQX-based data quality rules
- Development of data pipelines and data models supporting monitoring and reporting
- Dashboards and trending views for business users and data owners
- Linkage between data quality rules, data usage, and critical data points
- Documentation of technical design, rule logic, and operating model
- Support for scaling the solution to additional Clinical data domains
Developer Profile
We are looking for a Senior Data Engineer / Databricks Developer with strong experience in building scalable data solutions and implementing data quality frameworks.
The ideal profile is self-driven and capable of owning end-to-end delivery, from technical design and data pipeline development to implementation of data quality rules and support for business-facing dashboards.
Must-have skills
- Strong hands-on experience with Databricks
- Experience with Spark, SQL, Delta Lake, and Python
- Experience designing and implementing data pipelines / ETL-ELT
- Experience with data quality frameworks, preferably DQX
- Understanding of data governance, data ownership, and rule-based data quality monitoring
- Ability to translate business requirements into scalable technical solutions
- Experience working in complex enterprise environments
Nice-to-have skills
- Experience with regulated or compliance-heavy environments
- Experience with clinical operations, trial operations, or life sciences data
- Experience with dashboarding and business-facing data quality reporting
- Azure DevOps / CI-CD experience
- Experience with integrations, APIs, or downstream system connectivity
- Snowflake experience
- Understanding of Veeva or related clinical systems
Personal profile
The consultant should be proactive, structured, and able to work independently in an environment where requirements may evolve.
The person should be comfortable engaging with both technical stakeholders and business users and should be able to help shape a practical, scalable solution rather than only implementing predefined tasks.
Start date: 17-08-2026
End date: 16-02-2026
Location: Søborg, Denmark OR remote nearshore
** Physical location for the consultant can be both DK or nearshore (Europe timezone)
For the duration of this assignment Ework Services (0,9%) will be deducted from the total amount invoiced.
We offer candidates continuously. This means that we sometimes remove the assignments before deadline. If you are interested, we recommend that you apply immidiately.
- Locations: Remote
- Technologies: Azure, Data Pipelines, Databricks, DevOps, ETL, Integrations, Python, SQL, Snowflake, Spark
- Language: English