- Company Name
- Aaron Consulting Inc.
- Job Title
- Kafka Developer
- Job Description
-
**Job Title**
Kafka Developer
**Role Summary**
Design, develop, and maintain high‑throughput, event‑driven messaging solutions using Apache Kafka. Collaborate with cross‑functional teams to integrate Kafka with microservices, REST APIs, and data stores, ensuring reliability, scalability, and performance in production environments.
**Expectations**
- Minimum 8 years of hands‑on experience with Apache Kafka (core, producers, consumers).
- Proven expertise in Kafka Streams, Kafka Connect, or KSQL.
- Strong Java development background (Java preferred) with additional knowledge of Scala or Python.
- Demonstrated ability to work with distributed systems, Linux/Unix, and CI/CD pipelines.
- Effective communication and problem‑solving skills in a global, remote‑friendly setting.
**Key Responsibilities**
- Architect and implement Kafka‑based pipelines, topics, and consumer groups.
- Develop, test, and deploy Kafka producers, consumers, and stream processing applications.
- Integrate Kafka with RESTful services, microservices, and JSON payloads.
- Optimize partitioning, replication, and offset management for performance and fault tolerance.
- Create and maintain CI/CD workflows and Git repositories for Kafka projects.
- Collaborate with data engineering teams to connect Kafka to relational and NoSQL databases using SQL and appropriate connectors.
- Monitor, troubleshoot, and resolve production issues, including latency, data loss, and scaling challenges.
- Document designs, configurations, and operational procedures.
**Required Skills**
- Apache Kafka (core, producers, consumers) – 8+ years
- Kafka Streams, Kafka Connect, or KSQL
- Java (primary); Scala or Python (optional)
- Distributed systems & event‑driven architecture
- Linux/Unix administration and scripting
- REST APIs, microservices, JSON integration
- Strong SQL knowledge; experience with RDBMS/NoSQL integration
- Git version control; CI/CD pipeline tools (e.g., Jenkins, GitLab CI)
- Understanding of partitions, offsets, consumer groups, replication, and delivery semantics
**Required Education & Certifications**
- Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent professional experience).
- Preferred: Confluent Certified Developer for Apache Kafka or similar Kafka certification.