git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Flink leaves a lot RocksDB sst files in tmp directory


Dear all,

While running Flink 1.6.1 with RocksDB as a backend and hdfs as checkpoint FS, I've noticed that after a job has moved to a different host it leaves quite a huge state in temp folder(1.2TB in total). The files are not used as TM is not running a job on the current host. 

The job a5b223c7aee89845f9aed24012e46b7e had been running on the host but then it was moved to a different TM. I'm wondering is it intended behavior or a possible bug?

I've attached files that are left and not used by a job in PrintScreen.

Attachment: Screenshot from 2018-10-09 14-21-23.png
Description: PNG image