Data Engineer

Salary: £? - ? per year

Requirements

• Proven experience leading data engineering teams, with a strong track record of mentoring and developing junior engineers.
• Expert knowledge of Python and Airbyte CDK, with experience building custom data connectors.
• Strong experience developing ELT pipelines using PySpark in Databricks within a Medallion Architecture.
• Experience with Terraform and deploying Airbyte connections and Databricks assets using GitHub Actions.
• Confident working with JIRA, GitHub, and VS Code.
• Experience with Databricks Delta Live Tables (DLT) is desirable.
• Knowledge of Databricks Asset Bundles is desirable.

Responsibilities

• Lead a high-profile data engineering project as an experienced Lead Data Engineer.
• Mentor and develop junior engineers as part of our data engineering team.
• Build custom data connectors using Python and Airbyte CDK.
• Develop ELT pipelines using PySpark in Databricks within a Medallion Architecture.
• Deploy Airbyte connections and Databricks assets using Terraform and GitHub Actions.
• Work collaboratively using JIRA, GitHub, and VS Code.

Technologies

• Databricks
• GitHub
• JIRA
• Python
• PySpark
• Terraform
• VS Code

More

We are offering a 3-month initial contract for a Lead Data Engineer on an outside IR35 basis at £500–£525 per day. This is a hybrid role based in London, with 2 days per week onsite and the remainder worked remotely. We are looking for someone to join a high-profile project and make a strong impact within our data engineering team.

last updated 27 week of 2026