- Company Name
- SPG Resourcing
- Job Title
- Data Engineer
- Job Description
-
**Job Title**
Data Engineer
**Role Summary**
Design, build, and maintain end‑to‑end data pipelines and semantic models on Microsoft Azure. Deliver robust, secure, and high‑performance data solutions that support mission‑critical services, ensuring governance, compliance, and optimal query performance.
**Expectations**
- 3‑5+ years in data engineering or related data delivery roles.
- Strong track record delivering modern Azure‑based data platforms.
- Demonstrated ability to work with technical and non‑technical stakeholders.
**Key Responsibilities**
- Develop and maintain data pipelines using Azure Data Factory, Synapse Analytics, and Azure Data Lake Storage.
- Create and optimize Power BI datasets and semantic models, including DAX tuning.
- Ingest, transform, and integrate data from diverse source systems into secure, centralised storage layers.
- Apply ETL/ELT best practices to ensure efficiency, resilience, and scalability.
- Collaborate with Data Architects to translate designs into production solutions.
- Implement data governance, security, and compliance measures (GDPR, NHS IG, etc.).
- Monitor, troubleshoot, and optimise pipeline and query performance.
- Produce and maintain thorough documentation of data flows, transformations, and dependencies.
- Support deployment and use of data cataloguing, lineage, and quality monitoring tools.
**Required Skills**
- Expertise in Azure Data Factory, Synapse Analytics, Azure Data Lake Storage, and Power BI (dataset creation, semantic modelling, DAX).
- Strong understanding of conceptual, logical, and physical data modelling.
- Experience with performance tuning and query optimisation in Azure environments.
- Knowledge of data governance, privacy, and compliance frameworks.
- Ability to manage large, complex datasets in enterprise or public‑sector contexts.
- Excellent communication skills for cross‑functional collaboration.
**Required Education & Certifications**
- Microsoft Certified: Azure Data Engineer Associate or equivalent.
- Microsoft Certified: Power BI Data Analyst Associate (preferred).
- Bachelor’s degree in Computer Science, Information Systems, or related field (or equivalent practical experience).