'Upgrading apache kafka to confluent kafka
We are planning to upgrade our existing apache kafka cluster to confluent kafka while upgrading do we have any data loss in the topics?? And also main reason we are upgrading is to use s3 sink connector is there any connector which is available in apache kafka itself?
Solution 1:[1]
Unless you want to migrate to Confluent Server, there is nothing you need to migrate; Confluent Platform includes Apache Kafka
Kafka Connect, on the other hand, is a pluggable environment, and doesn't require Confluent tools/systems other than the specific JAR file(s) for the S3 Connector
Solution 2:[2]
You can use S3 sink connector from apache camel
Just need to download the S3 sink connector jar file from this link: https://camel.apache.org/camel-kafka-connector/next/reference/index.html
Copy the jar file in connector plugins path. It depends on value of your properties. By default on the relative path: plugins/connectors, or set in plugin.path property.
So you don't need to restart and lost any data.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|---|
| Solution 1 | OneCricketeer |
| Solution 2 |