Apache Kafka - Upgrade
PaaS upgrade workflow
Request
Upgrading an Apache Kafka PaaS operating in KRaft mode is managed by cegedim.cloud and can be requested through an ITCare ticket. Please specify your preferred time slot for the upgrade.
Indicate clearly if the upgrade must be performed outside of business hours for RFC planning purposes.
It is recommended to first perform the upgrade on non-production environments to validate the new metadata version.
Migration from Apache Kafka clusters operating in ZooKeeper mode to KRaft mode is not supported by cegedim.cloud !
This limitation is due to significant structural changes introduced with KRaft mode starting from version 3.x.
To use KRaft mode, you must perform a new installation and then migrate your application data to the new cluster.
Process
The Kafka cluster upgrade follows these steps in Rolling Update mode:
Sequential upgrade of Kafka brokers & controllers without a total service outage.
Post-upgrade validation (health checks, monitoring).
Impacts
When upgrading Apache Kafka, anticipate the following potential impacts:
Kafka Clients (consumers and producers): Brief connection interruptions may occur during broker restarts. Clients should handle these temporary interruptions automatically.
Application Compatibility: Pre-check the compatibility of your applications and scripts with the new Kafka version.
Operating System Upgrade: An upgrade of Debian distribution may cause temporary service interruptions during node reboots.
Potential Risks:
Temporary traffic interruptions during sequential restarts.
Client compatibility issues with the new Kafka version.
Unexpected issues related to internal Kafka changes or OS upgrades.
Time references
Upgrading Apache Kafka from version 3.6.0 to 3.9.0 typically takes around 5 minutes on average.
These times are indicative and may vary depending on specific cluster configurations.
Operating System (OS) Upgrade
Upgrading the Debian Linux distribution from Debian 10 to Debian 12 can also be requested through an ITCare ticket.
This upgrade is automated and typically takes around 10 minutes per node.
OS Upgrade Best Practices
Check application compatibility.
Validate the procedure in non-production environments beforehand.
Supported OS / Apache Kafka Compatibility Matrix
Linux distributions supported by cegedim.cloud according to Apache Kafka version.
Apache Kafka and OS Compatibility Table
Apache Kafka 2.7
Debian 10
Apache Kafka 3.6
Debian 12
Apache Kafka 3.9
Debian 12
Last updated