Lead Data Engineer

End Date Tuesday 04 August 2026 We Support Flexible Working – Click here for more information on flexible working options Flexible Working Options Hybrid Working Job Description Summary The Data Engineer will work alongside the Team Product Owner in a Feature Team managing delivery by leading others. They will operate as co-leader with the Team PO with involvement in decision making and planning of Product roadmap. In some cases, this role will be an Individual Contributor operating at Lab rather than feature team level. Job Description - Data Engineer (Grade F) – GCP, Payments Domain As a Lead Data Engineer, you will lead a high-performing team to architect and implement advanced data solutions for the payment’s domain. You will be responsible for SOI (BigQuery) and SOE (Spanner) systems and work on high-volume, low-latency systems that process payment events in real-time. • Leadership & Team Management: Lead a cross-functional team of data engineers, guide career development, manage hiring and performance, and foster an Agile culture • Architectural Design: Define and implement scalable, high-performance architectures for SOI and SOE using BigQuery, Spanner, Kafka, Flink, and Dataflow • Data Modelling: Design complex, scalable data models for SOE systems, with a focus on high-volume, real-time payment data processing • Real-Time Streaming: Lead the development of event-driven architectures with Kafka and Flink for real-time data transformation • ISO 20022 Standards: Develop solutions based on financial data standards like ISO 20022, handling various payment formats (e.g., BACS, CHAPS) • Legacy System Migration: Oversee the migration of legacy data from on-premises systems to GCP, ensuring smooth transitions and minimal downtime • Optimization & Monitoring: Continuously monitor and optimize pipelines for performance, cost-efficiency, and low-latency processing • Strategic Collaboration: Work with business stakeholders, architects, and product managers to define the roadmap and ensure the alignment of technical solutions with business needs • CI/CD & Automation: Oversee the implementation of CI/CD processes and ensure seamless integration of code through Jenkins, Harness, and Terraform