If you are new to Kafka, please read the first three posts of the series given below. Else dive in. Introduction to Kafka Kafka Internals Reliable Data Delivery in Kafka How do your monitor your Kafka setup? There are a number of measurement collected while Kafka is operational. We are going to collect these measurements... Continue Reading →
Apache Kafka Introductory Tutorial – Set up your first Kafka Producer and Consumer
PrerequisiteA basic understanding about Apache Kafka. Please go through the introduction once, should you need it.InstallationDownload the Kafka from here.Untar the tar file that is downloaded.tar -xzf kafka_2.11-2.1.0.tgzRun The Servercd kafka_2.11-2.1.0Start the zookeeper firstbin/zookeeper-server-start.sh config/zookeeper.propertiesZookeeper would be running at 2181 port. You can check that in the following log:[2018-12-25 14:32:23,634] INFO binding to port 0.0.0.0/0.0.0.0:2181... Continue Reading →
Introduction to Apache Kafka Concepts
What is Apache Kafka? Apache Kafka is a distributed streaming platform. This essentially means that Kafka has following capabilities: Publish and subscribe to the stream of records just like how message queue (e.g. RabbitMQ) works Store streams of records for specified time. Kakfa is not a replacement for database or a logging platform. However, kafka... Continue Reading →