Learning Apache Kafka Second Edition Table of Contents Learning Apache Kafka Second Edition Credits About the Author About the Reviewers www.PacktPub.com Support files, eBooks, discount offers, and more Why subscribe? Free access for Packt account holders Preface What this book covers What you need for this book Who this book is for Conventions Reader feedback Customer support Errata Piracy Questions 1. Introducing Kafka Welcome to the world of Apache Kafka Why do we need Kafka? Kafka use cases Installing Kafka Installing prerequisites Installing Java 1.7 or higher Downloading Kafka Building Kafka Summary 2. Setting Up a Kafka Cluster A single node – a single broker cluster Starting the ZooKeeper server Starting the Kafka broker Creating a Kafka topic Starting a producer to send messages Starting a consumer to consume messages A single node – multiple broker clusters Starting ZooKeeper Starting the Kafka broker Creating a Kafka topic using the command line Starting a producer to send messages Starting a consumer to consume messages Multiple nodes – multiple broker clusters The Kafka broker property list Summary 3. Kafka Design Kafka design fundamentals Log compaction Message compression in Kafka Replication in Kafka Summary 4. Writing Producers The Java producer API Simple Java producers Importing classes Defining properties Building the message and sending it Creating a Java producer with custom partitioning Importing classes Defining properties Implementing the Partitioner class Building the message and sending it The Kafka producer property list Summary 5. Writing Consumers Kafka consumer APIs The high-level consumer API The low-level consumer API Simple Java consumers Importing classes Defining properties Reading messages from a topic and printing them Multithreaded Java consumers Importing classes Defining properties Reading the message from threads and printing it The Kafka consumer property list Summary 6. Kafka Integrations Kafka integration with Storm Introducing Storm Integrating Storm Kafka integration with Hadoop Introducing Hadoop Integrating Hadoop Hadoop producers Hadoop consumers Summary 7. Operationalizing Kafka Kafka administration tools Kafka cluster tools Adding servers Kafka topic tools Kafka cluster mirroring Integration with other tools Summary Index Learning Apache Kafka Second Edition