When kafka consumers are subscribing to a topic, as and when messages are produced, they are consumed by the consumers. But due to high traffic or latency or high load issues, there would be a lag in consuming the messages....
Read moreStatus of offsets of consumer groups are stored on Kafka broker. If that should be reset, for ex based on a duration ./bin/kafka-consumer-groups --bootstrap-server kafkaserver:9092 --group consumergroupname --reset-offsets --by-duration 1522760000 --execute If that should be reset, for ex based on...
Read moreWith curl commands, schemas can be retrieved/updated to Confluent SchemaRegistry. Get the latest schema available on the topic: curl -X GET http://localhost:8081/subjects/testtopic-value/versions/latest Get Schema compatibility: curl -X GET http://localhost:8081/config/testtopic-value Get versions of all registered schemas on a topic: curl -X...
Read moreIn this post we setup Confluent Kafka, Zookeeper and Confluent Schema registry on docker and try to access from outside the container. Install docker and make sure you have access access to run docker commands like docker ps etc. Create Read more…
Zookeeper plays the role of coordinating with servers in fail over scenarios, stores naming and configuration information, meta info. For more info visit : https://zookeeper.apache.org/ Kafka needs Zookeeper to maintain its state and store topics, acls cluster information. To maintain Read more…
Acl stand for Access control list. Acls are added on resources like topics or group to provide authorization to producers or consumers. Acls can be added with specific parameters like operation or producer or consumer. Below I will provide few Read more…
Add one kafka topic with 2 replicas and 4 partitions with the below command Add multiple kafka topics with 2 replicas and 4 partitions with the below command