- Company Name
- TalkTalk
- Job Title
- Platform Engineer
- Job Description
-
**Job title:** Platform Engineer
**Role Summary:**
Design, build, and maintain Microsoft Azure infrastructure using Terraform as the single source of truth. Develop and optimise CI/CD pipelines in Azure DevOps for automated deployment of workspaces, Unity Catalog, networking, and security. Work with Databricks (Spark/Scala, PySpark) to support ingestion frameworks and platform-level libraries. Implement secure connectivity, monitor platform reliability, and partner with architects and product teams to enforce governance and best practices.
**Expectations:**
- Deliver end‑to‑end Azure infrastructure solutions with Terraform.
- Configure and maintain Azure DevOps pipelines for continuous delivery.
- Develop Databricks workloads in Spark/Scala and PySpark.
- Implement VNET injection, Private Link, firewall rules, DNS, RBAC, and other security controls.
- Monitor, troubleshoot, and optimise platform performance.
- Collaborate with architects, engineers, and product teams on governance, security, and automation.
- Document infrastructure, processes, and standards for adoption across engineering.
**Key Responsibilities:**
- Design and deploy Azure resources (networking, storage, compute) via Terraform.
- Create and maintain Azure DevOps pipelines (YAML) for deployment automation.
- Build and optimise Databricks ingestion pipelines and libraries using Spark/Scala and PySpark.
- Configure secure connectivity: VNET injection, Private Link, firewall, DNS, RBAC.
- Enable monitoring and logging with Azure Log Analytics, Monitor, Application Insights.
- Troubleshoot platform issues, identify performance bottlenecks, and implement improvements.
- Document architecture, procedures, and best practices for wider engineering use.
- Foster collaboration with cross‑functional teams to ensure compliance with governance and security standards.
**Required Skills:**
- Deep expertise in Microsoft Azure (virtual networks, firewall, storage, compute, security).
- Proven experience with Terraform for Azure resource management and governance.
- Hands‑on experience with Databricks, Spark/Scala, and PySpark.
- Proficiency in Azure DevOps pipelines (YAML, agents, service connections).
- Strong understanding of Azure Active Directory/Entra ID, RBAC, and service principals.
- Familiarity with Azure monitoring and logging (Log Analytics, Monitor, Application Insights).
- Excellent problem‑solving, collaboration, and communication skills.
- Experience in large‑scale enterprise environments and agile delivery.
**Required Education & Certifications:**
- Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent professional experience).
- Relevant Microsoft certifications preferred (e.g., Azure Solutions Architect Expert, Azure DevOps Engineer Expert, Azure Data Engineer Associate, or Databricks Certified Professional).