- Company Name
- Randstad Enterprise
- Job Title
- Data Engineer
- Job Description
-
**Job title:** Data Engineer
**Role Summary:**
Design, implement, and maintain a scalable, secure data platform on Microsoft Azure. Build end‑to‑end pipelines, enforce data governance, and enable self‑service analytics across the organization. Collaborate with product teams, data scientists, and IT to deliver high‑quality datasets and dashboards.
**Expectations:**
- Minimum 2 years of experience as a Data Engineer or Data Analyst.
- Master’s degree in IT, Computer Science, or related field.
- Fluent in English and French; proficiency in Dutch is a plus.
- Proven background with Azure services (Databricks, Data Factory, Synapse, Event Hubs, Logic Apps) and AWS.
- Strong programming skills in Python, SQL, and Java.
- Familiarity with distributed processing frameworks (Spark, Hadoop).
- Experience with CI/CD, Git, Azure DevOps, and DataOps practices.
**Key Responsibilities:**
1. Design and develop data ingestion, transformation, and storage pipelines using Azure Data Factory, Databricks, and optional Synapse.
2. Build and maintain data models, metadata repositories, and data catalogs.
3. Ensure data quality, compliance with GDPR and internal security standards.
4. Automate and monitor pipelines, implement error handling, and optimize performance.
5. Create and publish Power BI datasets, dashboards, and reports for internal stakeholders.
6. Collaborate with data scientists, analysts, product owners, and IT teams to understand data needs and deliver solutions.
7. Maintain CI/CD pipelines for data infrastructure (Git, GitHub, MLflow, PowerShell).
8. Evaluate and recommend new technologies and best practices for data engineering.
**Required Skills:**
- **Cloud & Data Platform:** Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Storage, Azure Event Hubs, Azure Logic Apps, AWS (S3, Redshift).
- **Programming & Frameworks:** Python, SQL, Java, Apache Spark, Hadoop.
- **Data Visualization:** Power BI.
- **Version Control & CI/CD:** Git, GitHub, Azure Repos, MLflow, PowerShell scripts.
- **ETL & Integration:** Design and implement ETL workflows, proficiency with ADF.
- **Governance & Security:** GDPR compliance, data security standards, DataOps principles.
- **Analysis & Testing:** Statistical analysis, unit/integration testing, data quality validation.
- **Agile & Collaboration:** Azure DevOps, scrum ceremonies, stakeholder communication.
**Required Education & Certifications:**
- Master’s degree in IT, Computer Science, Data Engineering, or a related field.
- Certifications such as Microsoft Certified: Azure Data Engineer Associate or Azure Data Fundamentals are advantageous.
- Valid professional credentials in data engineering or cloud technologies preferred.