- Company Name
- Ingenworks
- Job Title
- Kafka Platform Engineer
- Job Description
-
**Job title:** Kafka Platform Engineer
**Role Summary:**
Design, maintain, and scale an enterprise‑grade Apache Kafka deployment on AWS using the Confluent Platform. Deliver reliable, secure, and high‑performance streaming solutions, orchestrated with Kubernetes and Terraform. Lead monitoring, performance tuning, and governance of Kafka environments for a FinTech ecosystem.
**Expectations:**
- Build and operate robust Kafka clusters with continuous improvement.
- Drive architectural excellence and scalability for new streaming use cases.
- Ensure compliance with security, governance, and disaster recovery requirements.
- Mentor peers and influence platform strategy.
**Key Responsibilities:**
- Manage and optimize existing Apache Kafka and Confluent Platform on AWS.
- Conduct architectural reviews and recommend enhancements.
- Collaborate with engineering and product teams to integrate new use cases and define scalable streaming patterns.
- Implement and maintain Kafka producers/consumers, Connectors, and Kafka Streams applications.
- Enforce governance around topic design, schema evolution, partitioning, and data retention.
- Monitor, troubleshoot, and tune Kafka clusters using Confluent Control Center, Prometheus, and Grafana.
- Automate Kafka infrastructure deployment and scaling with Kubernetes (EKS) and Terraform.
- Ensure high availability, security, and disaster recovery of the streaming platform.
- Mentor engineers and lead Kafka‑related initiatives.
**Required Skills:**
- 8+ years in platform engineering, 3+ years with Apache Kafka.
- Strong Kafka client development (Java or Python).
- Deep expertise with Confluent Platform (Brokers, Schema Registry, Control Center, ksqlDB).
- Experience deploying Kafka on AWS (MSK, EC2‑based).
- Proficient with Kubernetes (especially EKS) and Helm.
- Hands‑on with Kafka Connect, Kafka Streams, and schema management.
- Infrastructure automation with Terraform.
- Familiarity with monitoring stacks: Prometheus, Grafana, ELK or similar.
**Preferred Qualifications:**
- FinTech or regulated industry experience.
- Security best practices: TLS, SASL/OAuth, RBAC, encryption at rest.
- Exposure to Flink, Spark Streaming, or similar stream engines.
- Kafka governance and multi‑tenant topic strategy experience.
**Required Education & Certifications:**
- Bachelor’s degree in Computer Science, Engineering, or related field.
- Kafka certification (e.g., Confluent Certified Developer or Administrator) is a plus.