git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Question about sketches aggregation in druid


Hi All,
My name is Eshcar Hillel from Oath research. I'm currently working with Lee Rhodes on committing a new concurrent implementation of the theta sketch to the sketches-core library.I was wondering whether this implementation can help boost the union operation that is applied to multiple sketches at query time in druid.From what I see in the code the sketch aggregator uses the SynchronizedUnion implementation, which basically uses a lock at every single access (update/read) of the union operation. We believe a thread-safe implementation of the union operation can help decrease the inherent overhead of the lock.
I will be happy to join the meeting today and briefly discuss this option.
Thanks,Eshcar   




( ! ) Warning: include(msgfooter.php): failed to open stream: No such file or directory in /var/www/git/apache-druid-developers/msg00448.html on line 74
Call Stack
#TimeMemoryFunctionLocation
10.0006363032{main}( ).../msg00448.html:0

( ! ) Warning: include(): Failed opening 'msgfooter.php' for inclusion (include_path='.:/var/www/git') in /var/www/git/apache-druid-developers/msg00448.html on line 74
Call Stack
#TimeMemoryFunctionLocation
10.0006363032{main}( ).../msg00448.html:0