[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (FLINK-11049) Unable to execute partial DAG

Jeff Zhang created FLINK-11049:

             Summary: Unable to execute partial DAG
                 Key: FLINK-11049
             Project: Flink
          Issue Type: Bug
          Components: Job-Submission
    Affects Versions: 1.7.0
            Reporter: Jeff Zhang

val benv = ExecutionEnvironment.getExecutionEnvironment
val btEnv = TableEnvironment.getTableEnvironment(benv)
val data = benv.fromElements("hello world", "hello flink", "hello hadoop")
data.writeAsText("/Users/jzhang/a.txt", FileSystem.WriteMode.OVERWRITE);
val table = data.flatMap(line=>line.split("\\s")).
  map(w => (w, 1)).
  toTable(btEnv, 'word, 'number)
btEnv.registerTable("wc", table)
btEnv.sqlQuery("select word, count(1) from wc group by word").

In the above example, the last statement will trigger the 2 job execution (writeAsText and print), but what user expect is the print job. The root cause is that currently, flink unable to submit partial dag. 

This message was sent by Atlassian JIRA