Data Platform Engineer

Salary: £? - ? per year

Requirements

• Strong AWS cloud platform migration experience
• Strong Terraform and Infrastructure as Code (IaC) skills
• In-depth data engineering experience
• Experience with Python, PySpark and SQL
• Experience with data pipeline development, ETL/ELT design, data modelling, data quality and data validation
• Experience with AWS cloud data platforms, including S3 and IAM
• Understanding of CI/CD concepts, DevOps principles and Agile delivery
• Government, public sector or similar large-scale transformation experience strongly preferred
• Active SC clearance or full eligibility to undergo the SC security clearance process
• Advantageous experience with Databricks, Palantir Foundry, Foundry Pipeline Builder, Ontology concepts, Delta Lake, Secure Data Environment (SDE) and NHS/healthcare data

Responsibilities

• Support the delivery of large-scale data processing solutions
• Support a major data platform modernisation programme
• Migrate data pipelines, notebooks and data workloads from a legacy Databricks environment to modern AWS cloud-based data platforms
• Develop and maintain Terraform code to support data platform deployments
• Support deployment of data platform components, jobs, permissions and environment configurations
• Analyse current data engineering solutions and identify data migration requirements
• Onboard datasets, users and workloads onto the target platform

Technologies

• AWS
• CI/CD
• Cloud
• Databricks
• DevOps
• ETL
• IAM
• Support
• Python
• PySpark
• SQL
• Security
• Terraform

More

We are a leading global IT transformation business specialising in large-scale Government projects. This is a 6-month rolling contract for a Data Platform Engineer based in London with a hybrid working model, typically 3-4 days remote and 1-2 days in the office, plus occasional travel to our Leeds office. The role offers the opportunity to work on a major data platform modernisation programme and contribute to the migration of critical data assets into our AWS cloud environment.

last updated 30 week of 2026