git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: IntervalJoin is stucked in rocksdb'seek for too long time in flink-1.6.2


Yes, you are right. I add log to record the time of seek and find that
sometimes it is very slow. Then I use the rocksdb's files to test locally
and the same problem appears. It is very weird to find that rocksdb's seek
iterate data one by one. Until now, I add cache for rocksdb. The time is
faster than before but not solved completely. Added code is below:
                public ColumnFamilyOptions createColumnOptions() {
                        // return new ColumnFamilyOptions();
			BlockBasedTableConfig blockBasedTableConfig = new
BlockBasedTableConfig();
			blockBasedTableConfig.setBlockCacheSize(1024 * 1024 * 1024);
			ColumnFamilyOptions columnFamilyOptions = new ColumnFamilyOptions();
			columnFamilyOptions.setTableFormatConfig(blockBasedTableConfig);
			return columnFamilyOptions;
		}




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/