[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: VerifyError when running Python streaming job

hmm, i was able to run it with 1.5.2 at least. Let's see what 1.6 says...

On 08.08.2018 10:27, Chesnay Schepler wrote:
I'll take a look, but it sounds like the source is the issue?

On 08.08.2018 09:34, vino yang wrote:
Hi Joe,

Did you try the word_count example from the flink codebase?[1]

Recently, I tried this example, it works fine to me.

An example of an official document may not guarantee your success due to maintenance issues.

cc @Chesnay

Thanks, vino.

Joe Malt <jmalt@xxxxxxxx> 于2018年8月8日周三 上午5:29写道:

I'm running into errors when trying to run a Flink streaming program. 

Running the WordCount example from the docs fails with this error:

java.lang.VerifyError: (class: site$py, method: _Helper$26 signature: (Lorg/python/core/PyFrame;Lorg/python/core/ThreadState;)Lorg/python/core/PyObject;) Incompatible argument to function
	at java.lang.Class.getDeclaredConstructors0(Native Method)
	at java.lang.Class.privateGetDeclaredConstructors(
	at java.lang.Class.getConstructor0(
	at java.lang.Class.getConstructor(
	at org.python.core.BytecodeLoader.makeCode(
	at org.python.core.util.importer.getModuleCode(
	at org.python.core.util.importer.importer_load_module(
	at org.python.modules.zipimport.zipimporter.zipimporter_load_module(
	at org.python.modules.zipimport.zipimporter$zipimporter_load_module_exposer.__call__(Unknown Source)
	at org.python.core.PyBuiltinMethodNarrow.__call__(
	at org.python.core.imp.loadFromLoader(
	at org.python.core.imp.find_module(
	at org.python.core.imp.import_next(
	at org.python.core.imp.import_first(
	at org.python.core.imp.load(
	at org.python.core.Py.importSiteIfSelected(
	at org.python.util.PythonInterpreter.<init>(
	at org.python.util.PythonInterpreter.<init>(
	at org.python.util.PythonInterpreter.<init>(
	at org.apache.flink.streaming.python.util.InterpreterUtils.initPythonInterpreter(
	at org.apache.flink.streaming.python.util.InterpreterUtils.deserializeFunction(
	at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(
	at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(

The only job I can get to run is one that reads from a KafkaConsumer010 and outputs the result without applying any operations (if there is a Filter, Map, etc. it will crash with the same error). However, removing all the operations from the WordCount example doesn't fix the issue there.

I'm running Flink 1.6-RC, I've also tried 1.6-SNAPSHOT which made no difference.

Any help would be much appreciated.


Joe Malt

Software Engineer Intern