- Company Name
- micro1
- Job Title
- Senior Data Engineer
- Job Description
-
Job Title: Senior Data Engineer
Role Summary:
Design, orchestrate, and maintain high‑performance data pipelines and architecture for supply chain and manufacturing data systems in the healthcare and pharma sector. Deliver reliable, real‑time data access across multiple enterprise systems and cloud platforms.
Expactations:
- Build scalable, maintainable data solutions that support business intelligence and analytics.
- Ensure data quality, governance, and security across all pipelines.
- Collaborate with cross‑functional teams to meet stakeholder requirements.
Key Responsibilities:
- Architect and develop data pipelines using Hadoop, Spark, Kafka, and cloud services (AWS, Azure, GCP).
- Integrate enterprise sources (SAP, MES, LIMS, OMP, Kinaxis, Anaplan) and build data models for warehouses and lakes.
- Implement ETL processes with Talend, Informatica, Apache NiFi, or similar tools.
- Deploy, monitor, and troubleshoot pipelines using CI/CD practices and observability tools.
- Define and enforce data quality, lineage, and governance standards.
- Provide technical guidance and support to junior engineers.
- Travel to client sites as needed for requirement gathering and solution deployment.
Required Skills:
- 3+ years data engineering experience focused on supply chain/manufacturing data.
- Proficiency in Python (or equivalent language).
- Expertise in big data technologies: Hadoop, Spark, Kafka.
- Cloud platform experience: AWS, Azure, or GCP.
- Hands‑on with ETL/ELT tools: Talend, Informatica, Apache NiFi, etc.
- Data modeling, warehousing, and lake design.
- Familiarity with distributed computing, CI/CD pipelines, and monitoring.
- Strong data quality, governance, and security knowledge.
- Excellent communication, problem‑solving, and teamwork.
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Data Engineering, or related field (or equivalent experience).
- Professional certifications (e.g., AWS Certified Data Analytics – Specialty, Azure Data Engineer Associate, or GCP Professional Data Engineer) preferred.