- Company Name
- Methis Consulting
- Job Title
- Experienced data engineer
- Job Description
-
**Job Title**
Experienced Data Engineer
**Role Summary**
Data Engineer with 3+ years of experience designing, implementing, and maintaining scalable data architectures (databases, data lakes, warehouses). Develop and optimize ETL pipelines, create unified gold datasets, ensure data quality, and collaborate with cross‑functional teams to meet business data needs. Strong technical proficiency in Databricks (AWS), Python, SQL, and modern data engineering practices.
**Expectations**
- Deliver robust, secure, and high‑performance data solutions.
- Maintain consistent, accurate, and high‑quality data throughout its lifecycle.
- Communicate effectively with business owners, analysts, and developers.
- Produce clear documentation and adhere to agile delivery standards.
**Key Responsibilities**
1. Design, implement, and maintain scalable data architectures (databases, data lakes, warehouses).
2. Build and optimize ETL pipelines to ingest data from varied sources into data repositories.
3. Combine disparate data sources to create cohesive, unified gold datasets for analysis and reporting.
4. Ensure data consistency, accuracy, and quality across all stages of the data pipeline.
5. Partner with analysts, software developers, and business data owners to understand requirements and deliver insights.
6. Collaborate with teams to guarantee scalability, security, and performance of data systems.
7. Create and maintain comprehensive documentation for data processes, pipelines, and architectures.
**Required Skills**
- Python programming (ETL, data processing).
- SQL (data modeling, querying).
- Databricks (preferably on AWS).
- Experience with data processing technologies (Spark, Kafka, etc.).
- Proficiency in Azure DevOps, release pipelines, Git, and CI/CD using Agile tools (Jira, Azure Boards).
- Knowledge of Agile methodologies (Scrum, Kanban).
- Native-level fluency in French **or** Dutch and conversational ability in the other language.
- Strong written and verbal communication skills for documentation and stakeholder interaction.
**Required Education & Certifications**
- Master’s degree in Computer Science, Mathematics, Business Economics, or a closely related field.
- AWS Cloud Data Engineer certification is a plus.
- Experience or knowledge of utilities market, Salesforce, and SAP ISU is considered an advantage.
---