Lead Test Engineer (Azure Databricks)

Salary: £61,000 - 91,000 per year

Requirements

• We need an experienced Lead Test Engineer with hands-on testing experience on Azure Databricks platforms.
• We need someone with experience defining test strategy and building scalable automated testing frameworks.
• We need experience working with Azure DevOps CI/CD pipelines.
• We need experience introducing and embedding test-driven development practices.
• We need experience defining data quality checks and validation rules across ingestion and transformation stages, ideally using tools such as Soda Data Quality or DQX.
• We need the ability to lead, mentor, and review the work of test engineers while raising testing standards.
• We need someone who can collaborate effectively with data engineers, architects, and platform leads.
• We need strong documentation skills to record test strategy, framework, and standards.
• We need the ability to track and report on test coverage, defect trends, and platform quality metrics.
• We need candidates who are UK-based, do not require sponsorship, and are eligible to obtain SC Clearance.
• We need candidates who can start immediately or within two weeks.
• Previous experience on UK public sector programmes is highly desirable.

Responsibilities

• We define and own the test strategy for our Azure Databricks data platform.
• We design and implement a structured test framework to replace ad-hoc pytest usage, establishing consistent patterns, standards, and reusable components.
• We build Azure DevOps CI/CD pipelines that run automated tests and surface data and pipeline issues before production.
• We introduce and embed test-driven development practices across our engineering team.
• We define and implement data quality checks and validation rules across ingestion and transformation stages.
• We lead, mentor, and set direction for test engineers, reviewing their work and raising testing standards across the platform.
• We collaborate with data engineers, architects, and platform leads to embed testing early in the development lifecycle.
• We produce clear documentation of the test strategy, framework, and standards for ongoing use by our wider engineering team.
• We track and report on test coverage, defect trends, and platform quality metrics to programme and technical leads.

Technologies

• Azure
• CI/CD
• Databricks
• DevOps
• pytest
• Cloud
• TDD

More

We are working directly with an IT consultancy delivering major work across the UK public sector and looking for a Lead Test Engineer to join a key Azure Databricks programme. This is a fully remote UK-based contract role, paying £550 per day outside IR35 for an initial 6 months. We are seeking someone who can hit the ground running and help us raise testing standards across the platform.

last updated 32 week of 2026