Job Specifications
Senior Data Engineer – Burton on Trent
£64-67k
x1 day per week on-site
(Sponsorship is not provided for this opportunity)
As a Senior Data Engineer, you will lead the development and optimisation of our customers Azure-based data platform, ensuring efficient, secure, and high-performing data services. You’ll design scalable pipelines and data models, champion data governance and best practices, and drive continuous improvement to enhance data quality and accessibility across the business.
Key Responsibilities
Data Engineering: Design, build, and maintain Azure data pipelines using Data Factory, Databricks, and related services.
Data Architecture: Develop and optimise scalable data models, warehouses, and lakes (Azure Synapse, Data Lake Storage).
Governance & Security: Enforce compliance and data protection standards (GDPR, DPA) through robust security and governance practices.
Automation: Implement CI/CD pipelines and Infrastructure as Code (Terraform, Bicep, ARM) via Azure DevOps.
Performance & Monitoring: Optimise data systems for cost, performance, and reliability; proactively resolve platform issues.
Collaboration: Work closely with analysts and data scientists, mentoring junior engineers and promoting best practices.
Innovation: Explore new Azure technologies to enhance platform capabilities and analytics.
Documentation: Maintain clear technical documentation and share knowledge across teams.
Skills & Experience
Expert in Azure Databricks (Unity Catalog, DLT, cluster management).
Strong experience with Azure Data Factory, Synapse Analytics, Data Lake Storage, Stream Analytics, Event Hubs.
Proficient in Python, Scala, C#, .NET, and SQL (T-SQL).
Skilled in data modelling, quality, and metadata management.
Experience with CI/CD and Infrastructure as Code using Azure DevOps and Terraform.
Strong analytical, communication, and stakeholder engagement skills.
Exposure to machine learning engineering is desirable.
Interested? Please submit your updated CV to Olivia.Yafai@crimson.co.uk for consideration.
Not interested? Do you know someone who might be a perfect fit for this role? Refer a friend and earn £250 worth of vouchers!
Crimson is acting as an employment agency regarding this vacancy
About the Company
Crimson is a digital transformation consultancy that accelerates digital autonomy for ambitious organisations.
Crimson's recruitment services help source, attract, and retain visionary digital leaders as well as the best permanent and contract IT talent.
Leveraging the Microsoft platform and Crimson's unique portfolio, we work with customers as one team to build intelligent customer experiences, enable employee collaboration, and unlock actionable data insights.
Crimson has particular expertise in the higher education,...
Know more