Overview of brokers in Managed Service for Apache Kafka

A Kafka cluster is made up of one or more brokers. Producer applications send messages to brokers, and consumer applications connect to brokers to read messages. Multiple consumers can read messages in parallel, typically using a consumer group. Each partition in a topic is assigned a leader broker. The leader is responsible for replicating the partition data that it receives to other brokers.

When you create a Managed Service for Apache Kafka cluster, the service provisions a number of brokers based on the cluster's total vCPU and memory capacity. If you scale the cluster up or down, the service automatically scales the brokers, adding new brokers if needed. For details, see broker provisioning.

Managed Service for Apache Kafka provides APIs for viewing the brokers in your cluster. You can also use the open source Apache Kafka APIs to view and configure brokers. For more information, see the following pages: