- Company Name
- SKOTT GROUP
- Job Title
- Data Engineer (H/F)
- Job Description
-
**Job Title:**
Data Engineer (H/F)
**Role Summary:**
Architect, develop, and maintain scalable data solutions across multi‑industry environments. Leverage Hadoop, Spark, Kafka, ELK, and cloud platforms to deliver high‑performance data pipelines and analytics tools that support business decision making.
**Expectations:**
- Deep understanding of business challenges and IT infrastructure complexity.
- End‑to‑end ownership of data architecture, from requirement gathering to production deployment.
- Continuous improvement of data processes, algorithm performance, and platform reliability.
- Effective collaboration with business, analytics, and IT teams through clear communication and consultative engagement.
- Participation in research and best‑practice development within the Data Engineering practice.
**Key Responsibilities:**
- Gather and translate business requirements into technical specifications.
- Design, code, and deploy data pipelines using Python, Scala, or Java.
- Implement ETL flows, data ingestion, and real‑time streaming with Spark, Kafka, and ELK.
- Optimize and monitor Hadoop ecosystem components (HDFS, MapReduce, Hive, Spark).
- Integrate cloud infrastructures (Azure, AWS, GCP) for scalable storage and compute.
- Validate algorithm implementation and tune for performance.
- Document architecture, processes, and results for stakeholders.
- Mentor peers and contribute to practice knowledge base.
**Required Skills:**
- Proficiency in Python, Scala, or Java.
- In‑depth knowledge of Hadoop ecosystem (HDFS, MapReduce, Hive, Spark).
- Hands‑on experience with Kafka, ELK stack, and cloud infra (Azure, AWS, GCP).
- Strong analytical, problem‑solving, and debugging abilities.
- Excellent written and verbal communication; ability to present complex concepts to non‑technical audiences.
- Autonomy, rigor, and a curiosity-driven mindset.
**Required Education & Certifications:**
- Graduate from an engineering school or hold a Master’s/Ph.D. in Data Engineering, Data Science, or a related field.
- Demonstrated prior experience as a Data Engineer with proven project delivery.