Kafka Admin
Infosys Limited Hyderabad
- Kafka
Job Description
Responsibilities
Design, deploy, and manage large-scale Kafka clusters across on-premise and cloud environments
Lead architecture decisions for high availability, scalability, and fault tolerance
Monitor, troubleshoot, and optimize Kafka clusters to achieve optimal performance and uptime
Handle capacity planning, cluster sizing, and performance tuning
Manage advanced configurations including multi-cluster replication (MirrorMaker), tiered storage, and KRaft mode
Configure and enforce security best practices (SASL, SSL/TLS, RBAC, ACLs)
Implement robust backup, disaster recovery, and failover strategies
Collaborate with engineering teams to design efficient event-driven architectures and streaming pipelines
Resolve complex production issues and lead root cause analysis (RCA)
Automate infrastructure provisioning and operational tasks using tools like Terraform, Ansible, or scripts
Lead Kafka upgrades, migrations, and platform enhancements with minimal downtime
Establish and maintain monitoring, alerting, and logging frameworks
Mentor junior engineers and provide technical leadership
Create and maintain detailed documentation and operational runbooks
Additional Responsibilities
Bachelor’s or Master’s degree in Computer Science, IT, or a related field (or equivalent practical experience)
Technical and Professional Requirements
Primary skills:Technology->Java->Apache
5–9 years of IT experience with at least 3+ years in Kafka administration/engineering
Strong expertise in Apache Kafka internals (brokers, partitions, replication, ISR)
Deep understanding of distributed systems, messaging frameworks, and event streaming
Experience with Kafka ecosystem tools: Kafka Connect, Kafka Streams, Schema Registry
Hands-on experience with monitoring tools like Prometheus, Grafana, ELK, or Splunk
Strong Linux/Unix administration skills
Experience with cloud platforms (AWS MSK, Azure Event Hubs/Kafka, GCP Pub/Sub-Kafka integration)
Familiarity with containerization and orchestration (Docker, Kubernetes)
Expertise in scripting/programming (Python, Bash, or Java preferred)
Strong problem-solving skills with the ability to handle critical incidents
Preferred Skills
- Kafka
Educational Requirements
Bachelor of Engineering