Lead Data Engineer

Salary: £95,000 - 95,000 per year

Requirements

• We are looking for candidates with a range of skills and experience, and we encourage applications even if you do not meet every criterion.
• Proficiency in Git, including GitHub Actions, and the ability to explain the benefits of different branch strategies.
• Strong experience with Infrastructure as Code and the ability to guide infrastructure deployment across different environments.
• Knowledge of handling and transforming data types such as JSON and CSV using Apache Spark, Databricks, or Hadoop.
• Good understanding of modern data system architectures, including Data Warehouses, Data Lakes, and Data Meshes.
• Ability to create data pipelines in cloud environments and integrate error handling within them.
• Ability to create reusable libraries to encourage consistency across multiple data pipelines.
• Ability to document and present end-to-end diagrams for data processing systems in cloud environments, with some knowledge of C4, UML, or similar diagramming approaches.
• Enthusiasm for learning and self-development.
• Experience working on agile delivery-led projects and applying practices such as Scrum, XP, and Kanban.
• Ability to own the cloud infrastructure underpinning data systems through a DevOps approach.
• Experience designing and implementing efficient data transformation processes at scale in both batch and streaming use cases.
• Experience delivering data platforms as a skilled Data Engineer.
• Knowledge of SOLID, DRY, and TDD principles and how to apply them practically in projects.
• Ability to demonstrate a commercial mindset and grow accounts organically with senior stakeholders.
• Experience improving resilience by checking for software vulnerabilities and implementing appropriate testing strategies, including unit, integration, and data quality testing.
• Ability to offer guidance on implementing a robust DevOps approach in a data project.
• Comfort discussing tools and approaches used in DataOps, including orchestration, data integration, and data analytics.
• Eligibility for SC security clearance, which requires 5 years of UK residency and 5 years of employment history, or equivalent full-time education history, with limited time spent outside the UK in the last five years.

Responsibilities

• Play a pivotal role in helping public sector organisations become truly data-led by equipping them with robust data platforms.
• Join our data team in spreading data knowledge and skills beyond silos and into delivery teams.
• Help implement efficient data pipelines and storage.
• Define, shape, and improve data strategies across central and local government.
• Help public sector teams understand the value of their data and use it more effectively.
• Establish yourself as a trusted advisor in data-driven approaches using public cloud services such as AWS, Azure, and GCP.
• Contribute to our recruitment efforts.
• Take on line management responsibilities.
• Design and implement efficient data transformation processes at scale.
• Produce documentation and diagrams that explain cloud-based data processing systems.

Technologies

• AWS
• Azure
• Cloud
• Databricks
• DevOps
• GCP
• Git
• GitHub
• Hadoop
• Support
• JSON
• Kanban
• Security
• Slack
• Spark
• TDD
• UML
• XP
• Architect
• CI/CD
• Data Warehouse
• Docker
• Embedded
• LESS
• Machine Learning
• Network

More

We are Made Tech, a technology company on a mission to use technology to improve society for everyone. We help organisations transform, deliver, and manage world-class digital products and services, with a strong focus on public sector work. Our team culture is built around a happy, inclusive, and diverse workforce, with communities of practice, Slack communities, learning spaces, and support for mental health, neurodiversity, and connection. We offer benefits including 30 days of paid annual leave, flexible parental leave, part-time remote working, paid counselling, financial and legal advice, a 7% employer-matched pension, and a flexible benefits platform with options such as Smart Tech, Cycle to Work, and a health care cash plan.

last updated 30 week of 2026