- Company Name
- Mint Selection
- Job Title
- Azure Data Architect / Engineering Consultant
- Job Description
-
Job title: Azure Data Architect / Engineering Consultant
Role Summary:
Senior consultant responsible for designing, building, and delivering a cloud‑native, enterprise‑scale data platform on Azure. The platform ingests, processes, stores, and visualises operational telemetry to enable real‑time monitoring, alerting, and trend analysis across engineering, analytics, asset operations, and trading functions.
Expectations:
- Full ownership of the end‑to‑end platform lifecycle (discovery, architecture, implementation, handover).
- Deliver a modular, multi‑tenant lake‑house solution that meets performance, security, and governance standards.
- Mentor internal engineering and analytics teams, embedding best practices and ensuring transition to product ownership.
- Maintain project scope within 6‑12 month engagement while evaluating opportunities for broader infrastructure upgrade.
Key Responsibilities:
- Lead technical discovery sessions with data, trading, and operations stakeholders to capture requirements.
- Define architectural vision, design decisions, and implementation roadmap for Azure‑native services.
- Design and implement batch and streaming pipelines using Azure Data Factory, Databricks, and Spark Structured Streaming.
- Implement secure, scalable storage with Delta Lake and Azure Data Lake Gen2; model time‑series data in Azure Data Explorer or equivalent.
- Apply Medallion architecture principles; manage schema evolution, data validation, metadata, lineage, and observability.
- Establish access controls, encryption, cost‑monitoring, and governance policies following Azure best practices.
- Produce comprehensive documentation of infrastructure, pipelines, operational procedures and handover guides.
- Mentor and upskill internal data engineers and analysts; create coding standards, design patterns, and operational workflows.
Required Skills:
- Proven delivery of large‑scale Azure data platforms (Data Lake Gen2, Synapse, Databricks, Event Hubs, IoT Hub).
- Deep expertise in lake‑house architecture, real‑time and batch processing, and telemetry/IoT pipelines.
- Proficient in Spark (Structured Streaming), Delta Lake, Parquet, SQL, Python.
- Experience with time‑series databases (Azure Data Explorer, InfluxDB, TimescaleDB).
- Strong governance, security, cost‑optimisation, and observability practices.
- Ability to lead cross‑functional teams and mentor junior staff.
- Experience in energy, grid operations, or industrial IoT highly desirable.
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Engineering, or related field.
- Certified Microsoft Azure Data Engineer (DP‑203) or equivalent.
- Additional certifications in Azure Architecture or Data Lake preferred.