All thing coding
If you are new to Kafka, please read the first three posts of the series given below. Else dive in. Introduction to Kafka Kafka Internals Reliable Data Delivery in Kafka How do your monitor your Kafka setup? There are a number of measurement collected while Kafka is operational. We are going to collect these measurements... Continue Reading →
A quick recap of the basic terminology of Kafka can be found here. The fundamental unit that Kafka manages is called a message. Message is simply a byte array without any restriction of the format. As you would know, producers produce data to a topic. Each topic is further divided into multiple partitions. Messages are... Continue Reading →
PrerequisiteA basic understanding about Apache Kafka. Please go through the introduction once, should you need it.InstallationDownload the Kafka from here.Untar the tar file that is downloaded.tar -xzf kafka_2.11-2.1.0.tgzRun The Servercd kafka_2.11-2.1.0Start the zookeeper firstbin/zookeeper-server-start.sh config/zookeeper.propertiesZookeeper would be running at 2181 port. You can check that in the following log:[2018-12-25 14:32:23,634] INFO binding to port 0.0.0.0/0.0.0.0:2181... Continue Reading →
What is Apache Kafka? Apache Kafka is a distributed streaming platform. This essentially means that Kafka has following capabilities: Publish and subscribe to the stream of records just like how message queue (e.g. RabbitMQ) works Store streams of records for specified time. Kakfa is not a replacement for database or a logging platform. However, kafka... Continue Reading →