git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Java] org.apache.arrow.vector.ipc.ArrowWriter.recordBlocks


Hi all,
 In the context of ArrowStreamWriter:

- It looks like field ArrowWriter.recordBlocks is populated and consumes
memory, e.g. in ArrowWriter.writeRecordBatch

- But the List<ArrowBlock> is never used (it is used in ArrowFileWriter but
not ArrowStreamWriter)

Would it be safe for me to extend ArrowStreamWriter and override
writeRecordBatch with an implementation that does not populate the
recordBlocks?

This is for HIVE-19305 (if anyone has time to take a look and provide
feedback, that would be much appreciated)

Thanks for your help,

--Eric


( ! ) Warning: include(msgfooter.php): failed to open stream: No such file or directory in /var/www/git/apache-arrow-development/msg04304.html on line 87
Call Stack
#TimeMemoryFunctionLocation
10.0007363072{main}( ).../msg04304.html:0

( ! ) Warning: include(): Failed opening 'msgfooter.php' for inclusion (include_path='.:/var/www/git') in /var/www/git/apache-arrow-development/msg04304.html on line 87
Call Stack
#TimeMemoryFunctionLocation
10.0007363072{main}( ).../msg04304.html:0