Big Data Developer

Salary: £67,000 - 107,000 per year

Requirements

• Strong, hands-on SQL and Python experience
• Solid experience supporting and troubleshooting production ETL/data pipelines
• Proven expertise in data reconciliation, root-cause analysis, and incident management
• Excellent operational documentation and process mapping skills
• Ability to work independently, manage competing priorities, and communicate clearly with stakeholders
• Prior experience in Financial Services, market data, reference data, or enterprise data platforms is a plus
• Exposure to pipeline migration, automation, and data transformation programmes is a plus

Responsibilities

• Own, monitor, and execute end-to-end production data pipelines on weekly, monthly, and quarterly schedules
• Perform data controls, reconciliations, and validations
• Enhance pipelines for schema or source changes using SQL and Python
• Investigate failures, automate manual processes, and support data migration projects
• Perform root-cause analysis on pipeline failures, resolve data discrepancies, and manage recovery and re-run activities
• Build clear operational runbooks, SOPs, and process maps to close documentation gaps and support knowledge transfer
• Liaise with internal SMEs, vendors, and external data providers to support access, onboarding, and client requests within agreed SLAs

Technologies

• Big Data
• ETL
• Incident Management
• Support
• Python
• SQL

More

We are hiring a proactive Big Data Engineer for a remote, UK-based contract role on an initial 3-month basis. This role focuses on supporting and improving our critical data pipelines and enterprise datasets through production support, pipeline engineering, automation, and data quality management. The position is inside IR35 with an umbrella arrangement and offers the opportunity to play a pivotal role in reliable data delivery, incident resolution, and platform modernisation initiatives.

last updated 33 week of 2026