Tech Lead – Opentelemetry&Kafka

Job Description: OpenTelemetry & Kafka Expert
Role Overview
We are seeking an OpenTelemetry and Kafka Expert with 5+ years of hands-on experience in enterprise observability and streaming platforms.

The role focuses on designing, operating, and optimizing Kafka-based telemetry pipelines and OpenTelemetry instrumentation in large-scale production environments.

Key Responsibilities
Design, build, and operate Kafka-based streaming platforms for logs, metrics, and traces.

Configure and optimize Kafka clusters including brokers, topics, partitions, replication, and consumer groups.

Implement and manage Kafka security using SSL/TLS and SASL mechanisms.

Design and operate OpenTelemetry pipelines and collectors for metrics, logs, and distributed tracing.

Integrate telemetry data across logs, metrics, and traces for end-to-end observability.

Perform performance tuning, capacity planning, and reliability improvements for Kafka and OTel pipelines.

Troubleshoot complex production issues across Kafka, OpenTelemetry collectors, and downstream systems.

Manage and operate data/telemetry platforms ensuring stability, scalability, and compliance.

Collaborate with platform, SRE, and application teams to support enterprise observability use cases.

Mandatory Skills (Must-Have)
5+ years of hands-on experience with Apache Kafka in production environments.

Strong knowledge of Kafka architecture: brokers, partitions, replication, consumer groups, offsets.

Hands-on experience with Kafka security (SSL/TLS, SASL).

Strong hands-on experience with OpenTelemetry pipelines and collectors.

Experience integrating logs, metrics, and traces into a unified observability platform.

Proven expertise in performance tuning and production troubleshooting.

Experience managing enterprise-scale data or observability platforms.

Good-to-Have Skills
Experience with Kafka ecosystem tools (Schema Registry, Kafka Connect, Kafka Streams).

Experience integrating telemetry with tools such as Splunk, Prometheus, or similar platforms.

Exposure to Kubernetes/OpenShift-based observability.

Experience working in regulated or large enterprise environments.