git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

BK metrics


```> 2) If it's in milliseconds, are these numbers in expected range (see
> attached image). To me 2.5 seconds  (2.5K ms) latency for add entry request
> is very high.
2.5 seconds is very high, but your write rate is also high. 100,000 *
1KB is 100MB/s. SSD should be able to take it from the journal side,
but it depends on the hardware.

Have you tried reducing the write rate to see how the latency changes?
What is the client seeing for latency? I assume the client and all
servers have  10GigE nics?

Your images didn't attach correctly. Maybe they're too big to post
directly to the list. There is a size limit, but I don't know what it
is.

-Ivan```
@Ivan, for some reasons I did not receive your reply but found it in the email archives. I have copied your response in this email for the context.
At 80K request/sec throttling for record size of 1K, I am getting below throughput. The 99th percentile of `bookkeeper_server_ADD_ENTRY_REQUEST` and `bookkeeper_server_ADD_ENTRY` are around 350 ms. I am starting to see the lag when I increase the ingestion rate limit beyond 90 K/sec limit.
The disks were under 60% utilization (not saturated). All clients and server machines have 10G nics. 
Throughput (records/sec): 79505, Throughput (bytes): 75.8 MB/s, Latency (ms): average-118, 50th-106, 75th-139, 90th-193, 99th-395, 999th-658
Are there any benchmark results of BookKeeper that can be shared?
RegardsVijay