I've been using kafka (using the wurstmeister images, but i have also tried to set up the broker and zookeeper using the confluent images and it works) for a while and I am now trying to set up kafka-connect so I can directly load messages from a kafka topic to S3. However, i've been running into several issues. Qemu errors, java.lang.ExceptionInInitializerError at org.eclipse.jetty.http.MimeTypes, etc, which I have read that it has something to do with lack of ARM support (https://github.com/confluentinc/common-docker/issues/117 and https://github.com/docker/buildx/issues/542). I have tried to run the docker compose with platform: linux/amd64, but it still doesn't work.

I was wondering if anyone has any workarounds to make kafka-connect work or if you know any alternatives.

Thanks!

CodePudding user response：

You don't need Docker to run Kafka Connect.

• Install Java on your Mac
• Download Kafka
• Run Zookeeper and Kafka (this might have issues with M1 Mac)
• run bin/connect-distributed.sh config/connect-distributed.properties

If you really need Docker, you can rebuild images from other sources, such as mine, which builds from adoptopenjdk:11-jre base image, which supports ARM