Apache Kafka - Features
To take full advantage of Apache Kafka as a Distributed System, cegedim.cloud ensures that brokers are dispatched on multiple Availability Zones to maximize resiliency and redundancy.
Resiliency
The default cluster sizing includes 3 brokers provisionned over 3 Availability Zones.
The default configuration also ensure that the replication factor is set to 3 for topics and the minimum in-sync replica has to be 2.
This configuration garantees that all your topics and messages are replicated on all brokers over all the Availability Zones.
Note that provisioning more than 3 brokers will complexify things.
The more brokers, the more you will replicate your data. If you don't want to replicate more than 3 times, you will have to micro manage which topics and partitions are replicated and where in order to comply with your DRP for example.
High level diagram
Security
The provided Apache Kafka cluster is secured by the following means :
Inter broker communications secured with SASL_SSL
Client to broker communications secured with SASL_SSL
Secure controllers with ACLs
Controllers are managed by cegedim.cloud, simplifying your administration.
To connect to your secure Kafka cluster the following will be required :
The corresponding certificate
An existing and authorized user with a password (SCRAM-SHA-256)
Please refer to Apache Kafka - Get started to connect and interact with your Kafka cluster.
Default configuration
Important Apache Kafka broker parameters kept at default:
Custom configuration
Here are the kafka broker parameters that cegedim.cloud will modify during provisioning:
Last updated