Skills

Communication Leadership Python Data Engineering Apache Spark PostgreSQL CI/CD Databases apache AWS Agile AWS Cloud Spark

Job Specifications

Lead Consultant - Python Data Platforms - London (1-2 days onsite, hybrid) - Inside IR35 negotiable

Role Summary

We are looking for an experienced Lead Consultant with strong expertise in Python development and data platforms to join a strategic programme building a new AWS-based data platform for financial markets.

This role combines hands-on technical leadership with client-facing responsibilities. You will guide technical direction, ensure delivery quality, and oversee the design and build of scalable, cloud-native data solutions.

Key Responsibilities

Lead the design and delivery of a new data platform in AWS, ensuring scalability, performance, and resilience
Provide technical leadership and consultancy across multiple workstreams, guiding Python development and data engineering practices
Oversee the integration and processing of financial market data feeds (transactions, trading, asset management, FX)
Work with teams to design and maintain distributed data pipelines using Spark and Aurora PostgreSQL
Act as a trusted advisor to business and technology stakeholders, translating business requirements into technical solutions
Drive adoption of best practices in testing, CI/CD, Agile delivery, and cloud engineering
Mentor and support engineering teams, ensuring delivery quality and alignment with the programme roadmap

Skills & Experience Required

Proven track record as a Lead Consultant, Lead Engineer, or Technical Lead in financial services data platform projects
Strong expertise in Python for data-intensive systems
Deep understanding of financial market data (transaction feeds, asset management systems, trading platforms, FX)
Experience with Apache Spark for distributed data processing
Hands-on knowledge of Aurora PostgreSQL (or equivalent relational databases)
Extensive experience with AWS cloud services for data platform builds
Strong stakeholder engagement and consultancy skills, able to influence at senior levels
Excellent communication, leadership, and mentoring abilities

About the Company

Welcome to develop. We are a leading contributor to the software engineering community and a disruptive recruitment business comprised of eight specialised brands: develop .NET, develop Java, develop Python, develop PHP, develop JavaScript, develop DevOps, develop Change, and develop Technology. At develop, we scale the software engineering teams that shape our world. Our commitment to quality is reflected in our three key USPs: 1. Specialised Knowledge: All our Consultants learn to code in the language they recruit fo... Know more