I have a kafka consumer which is subscribing on a topic. Implementation is working fine. But when trying to implement unit tests for that, there's a problem bec
I'm using Kafka Admin client API's to create the topic. The topic is getting created, however the topic is getting created with 1 partition by default. The API
Headless service does not bind to new IPs. A pod restart is required. When both zookeepers and brokers restarted at same time brokers are not able to connect wi
I get an error when running kafka-mongodb-source-connect I was trying to run connect-standalone with connect-avro-standalone.properties and MongoSourceConnector
With spring-kafka, there is two types of Kafka listeners. Record Listeners : @KafkaListener(groupId = "group1", topics = {"my.topic"}) public void listenSingl
There might be a situation where even though the message is received from Kafka, but due to some reason (Database is down, webhook is offline or ...) still the
In spring-kafka, how do I add classes from a package to be trusted as a custom header field? The message is being sent like this: @Autowired private KafkaTemp
I'm trying to implement a Spring Boot-based Kafka consumer that has some very strong message delivery guarentees, even in a case of an error. messages from a pa
I'm working on a process that collect data from IBM MQ and process it to a kafka topic. To make sure not loosing any message,I need to commit my JMS message onl
I have deployed a Kafka cluster on a GCP instance. I used the connector through config/connect-distributed.properties. Start collecting data through restapi usi
I have the following Spring configuration for Kafka: import org.apache.kafka.clients.producer.ProducerConfig; import org.springframework.boot.context.properties
I use AWS MSK cluster with brokers logging turned on to CloudWatch. Logging works and I can see brokers logs. We have some topics with cleanup.policy=compact an
I am trying to interpret a Avro record stored by Debezium in Kafka, using Python { "name": "id", "type": {
I'm having some problems while getting kafka to work in a multi-broker cluster. It's managed by Ambari 2.6.3.0 and I installed kafka broker in both hosts and I
Getting exception while reading from kafka topic: Caused by: org.apache.kafka.common.errors.SerializationException: Error deserializing Avro message for
Zookeper is up and running in windows env.Now when i start Kafka server using .\bin\windows\kafka-server-start.bat .\config\server.properties nothing is dis
One way of achieving it could be by setting the properties parametermax.in.flight.requests.per.connection = 1. But I want to know if there is an even direct or
We got a SaaS which is publishing it's events on AWS eventbridge (coulple of milion per day). We would love to consume those events and put them on our self hos
I am very new to Kafka. I am creating two topics and publishing on these two topics from two Producers. I have one consumer which consumes the messages from bot
I am trying to set up Apache Kafka on my local machine to try it out following this official guide: https://kafka.apache.org/quickstart. However, when I tried