Senior Technical Lead

Salary: £42,000 - 82,000 per year

Requirements

• 10 years of total experience in software/data engineering, with 5 years leading delivery in an AWS data engineering environment
• Advanced hands-on expertise with Python (including PySpark & data engineering patterns)
• Extensive experience with AWS Glue (Jobs, Crawlers, Glue Studio, Glue Catalog, Job bookmarks)
• Proficiency in MWAA (Apache Airflow) (DAG design, scheduling, retries, best practices)
• Strong knowledge of broader AWS services: S3, Lambda, Step Functions, IAM, CloudWatch, KMS, Secrets Manager, Athena
• Proven experience delivering multiple end-to-end programs with measurable outcomes (SLAs, cost targets)
• Excellent stakeholder communication and executive presence
• Solid grounding in data modeling, data governance, security, and compliance
• Experience with CI/CD (e.g., CodePipeline/GitHub Actions), IaC (CloudFormation/Terraform), and containerization (Docker)
• Strong architectural thinking and delivery excellence skills
• Effective communication and influence skills

Responsibilities

• Lead the design and implementation of scalable ETL/ELT pipelines using AWS Glue, Python, and MWAA
• Define solution architectures, data models, orchestration patterns, and CI/CD for data workflows
• Own the technical roadmap and delivery plan, including sizing and risk mitigation
• Drive performance optimization (e.g., partitioning strategies, job tuning, retry/backoff strategies)
• Ensure robust observability and data quality checks
• Act as the technical point of contact for Senior Architects and Program Managers
• Present architecture decisions and trade-offs to senior stakeholders
• Manage vendor/partner coordination where relevant
• Establish coding standards and secure-by-design principles
• Implement DevSecOps principles for data
• Ensure compliance with data governance, security, and regulatory requirements
• Mentor and upskill engineers, fostering a culture of learning and continuous improvement

Technologies

• Airflow
• AWS
• AWS Glue
• Lambda
• CI/CD
• CloudWatch
• DevSecOps
• Docker
• ETL
• GitHub
• IAM
• Python
• PySpark
• Security
• Terraform
• Cloud
• Redshift
• Architect
• BitBucket
• Databricks
• DevOps
• Git
• Kafka
• SQL
• Spark

More

We are seeking a Senior Technical Lead to join our team in Norwich, Norfolk, on a contract basis for 6 months, working 3 days a week. In this role, you will combine hands-on engineering excellence with leadership to deliver end-to-end technical solutions for our AWS-based data platforms and pipelines. We offer a collaborative environment where you will engage with Directors, Senior Architects, and Program Leadership, ensuring our critical projects meet business outcomes. Join us to make a significant impact and lead our team towards innovative data solutions.

last updated 14 week of 2026