- Company Name
- Conferma Ltd
- Job Title
- Senior Data Engineer
- Job Description
-
**Job Title:** Senior Data Engineer
**Role Summary:**
Design, build, and maintain scalable data pipelines and architectures to support a global payments platform. Lead data engineering initiatives, ensure data reliability, and collaborate with cross‑functional teams to enable data‑driven decision making in a high‑growth fintech environment.
**Expectations:**
- Deliver robust, production‑grade data solutions on schedule.
- Uphold data quality, security, and compliance standards.
- Mentor junior engineers and promote best practices.
- Optimize performance and cost of data workflows.
- Communicate technical concepts clearly to stakeholders.
**Key Responsibilities:**
- Architect and implement ETL/ELT pipelines using technologies such as Apache Spark, Kafka, and Airflow.
- Develop and maintain data warehouses/lakes on cloud platforms (e.g., AWS Redshift, Snowflake, GCP BigQuery).
- Integrate diverse data sources (transactional, streaming, third‑party APIs) into unified schemas.
- Ensure data governance, lineage, and documentation.
- Conduct performance tuning, monitoring, and incident resolution.
- Collaborate with data scientists, analysts, and product teams to define data requirements.
- Lead code reviews, enforce CI/CD practices, and manage version control.
**Required Skills:**
- 5+ years of professional experience in data engineering or related roles.
- Proficiency in SQL and programming languages (Python, Java/Scala).
- Hands‑on experience with big‑data frameworks (Spark, Hadoop) and streaming platforms (Kafka, Kinesis).
- Strong knowledge of cloud data services (AWS, GCP, Azure) and infrastructure as code.
- Expertise in data modeling, warehousing, and ETL design patterns.
- Familiarity with containerization (Docker) and orchestration (Kubernetes).
- Understanding of payment processing data, security, and compliance (PCI DSS).
- Excellent problem‑solving, analytical, and communication skills.
**Required Education & Certifications:**
- Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field (or equivalent practical experience).
- Relevant certifications (e.g., AWS Certified Data Analytics, Google Professional Data Engineer, SnowPro Core) are a plus.
Manchester, United kingdom
On site
Senior
04-02-2026