Key Responsibilities

• Design, implement, and maintain Kafka-based integration solutions for real-time and batch data flows.
• Develop, enhance, and manage interfaces between Kafka and external systems , ensuring scalability, reliability, and security.
• Work closely with technical teams to integrate Kafka with Endur , leveraging knowledge of Endur tables and standard integration patterns.
• Optimize and troubleshoot Kafka clusters, producers, consumers, topics, and partitions .
• Ensure high availability, fault tolerance, and performance tuning within Kafka environments.
• Collaborate with architecture and development teams to define and enforce data streaming best practices .
• Provide mentorship and technical guidance on Kafka-related initiatives across the organization.

Required Skills & Experience

• Bachelor’s/Master’s degree in Computer Science, IT, or equivalent professional experience.
• Strong hands-on expertise with Apache Kafka , including cluster setup, configuration, scaling, and performance tuning.
• Demonstrated experience building Kafka-based integrations with third-party systems.
• Endur integration experience with an understanding of Endur database tables and integration patterns.
• Strong grasp of event-driven architecture , data streaming, messaging systems, and distributed processing.
• Proficiency in Java, Python , or similar programming languages for Kafka client development.
• Experience with Kafka Connect, Kafka Streams , and schema management tools (Avro, Protobuf).
• Knowledge of monitoring and troubleshooting tools such as Confluent Control Center, Prometheus, Grafana .
• Excellent analytical, debugging, and problem-solving skills.

Nice to Have

• Experience with cloud-hosted Kafka (AWS MSK, Confluent Cloud, etc.).
• Understanding of CI/CD pipelines and DevOps practices for Kafka deployments.
• Exposure to energy trading systems , especially Oil & Gas integration patterns.