Quantcast
Channel: Low latency topics
Browsing latest articles
Browse All 5 View Live

Low latency topics

Hello, We have a low-volume topic (~75msgs/sec) for which we would like to have a low propagation delay from producer to consumer. We have 3 brokers, each with a default of 4 partitions each. for a...

View Article



Low latency topics

Bob, The latency that you are seeing seems a little high. I would suspect at your low write rate, the # of partitions is too high. The simplest test for latency could be one producer, one broker...

View Article

Low latency topics

Hi Bob, Currently the broker does not hand out messages to consumers until they are flushed to disk, this means the flush interval acts as a lower bound on worst case latency. Setting that lower should...

View Article

Low latency topics

Oops, missed what you said--that you had already dropped the flush interval. Listen to Neha :-) -Jay -- Jay Kreps

View Article

Low latency topics

Found the problem. Now we are sub 400ms. While I was setting the per-topic flush interval, I failed to set the scheduler interval via log.default.flush.scheduler.interval.ms I was going to open a JIRA...

View Article

Browsing latest articles
Browse All 5 View Live




Latest Images