Job Specifications
We are seeking an experienced DevOps Confluent Kafka Architect who can design, and implement Kafka-based solutions using Confluent Cloud and Confluent Platform.
Role Objective:
Lead deployments and configurations of Kafka topics, partitions, replication strategies in both on-prem and cloud setups.
Automate provisioning, deployment, and maintenance tasks with Terraform, Chef, Ansible, Jenkins, or similar CI/CD tools.
Establish a Kafka Center of Excellence (COE) to drive enterprise-wide adoption, standardization, and best practices.
Define and implement strategic reference architectures for scalable and secure Kafka deployments.
Build self-service and governance frameworks to enable efficient and compliant Kafka usage across teams.
Skill set requirement:
Hands-on experience with Kafka; with focused on Confluent Cloud and Confluent Platform.
Deep knowledge of Kafka Connect, Schema Registry, Control Center, ksqlDB, and other Confluent components.
Experience architecting and managing hybrid Kafka solutions in on-prem and cloud (AWS, Azure, GCP).
Advanced understanding of event-driven architecture and the real-time data integration ecosystem.
Hands-on experience with Infrastructure as Code (Terraform, CloudFormation) for Kafka resource management in both cloud and on-prem.
Familiarity with Chef, Ansible, or similar configuration management tools to automate deployments.
Strong programming/scripting skills (Java, Python, Scala) for Kafka-based application development and automation tasks.
Skilled in CI/CD pipelines (e.g., Jenkins) and version control (Git) for distributed systems.
Proven ability to monitor and troubleshoot large-scale, distributed Kafka environments using Splunk, Datadog, Prometheus, or similar tools.
Experience with performance tuning and incident management to minimize downtime and data loss.
Expertise in securing Kafka deployments, including Kerberos and SSL configurations.
Understanding of IAM best practices, network security, encryption, and governance in hybrid environments.
Demonstrated experience leading platform upgrades, migrations, and architecture reviews.
Experience with container orchestration (Docker/Kubernetes) is a plus.
About the Company
Visionet is a premier digital technology solutions company built on the premise of disruptive innovation. For over 27 years, our innovation-centric and engineering-first approach has unlocked digital-driven success to over 350+ global enterprises across CPG, Retail, Banking & Financial Services, Food & Beverage, Manufacturing & Distribution, and Life Sciences industries.
Our strategic technological alliances with Microsoft, Google, Salesforce, Adobe and AWS, as well as accolades like Microsoft Partner of the Year 2021 and ...
Know more