I'm trying to use Kafka to send a message of ~10Mb. I know its default size is 1Mb, but is that a hard limit? Can librdkafka support >10Mb and how do I set it?

1 Answer

You need to configure the topic max.message.bytes (see ), and configure the producer with message.max.bytes (see ). Please allow some extra space (at least ~500 bytes) for protocol overhead.

6

Your Answer

Sign up or log in

Sign up using Google Sign up using Facebook Sign up using Email and Password

Post as a guest

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.