git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[DISCUSS] Support Higher-order functions


Hello all,

Spark 2.4.0 was released last month. I noticed that Spark sql in Spark 2.4 adds a lot of higher-order functions, to deal with complex data types easier[1].
For example, SQL statement like "SELECT TRANSFORM(values, element -> element + 1) FROM iteblog;"[2] returns an array that is the result of applying function to each element of array.
I wonder if it is possible for Calcite to enhance it's parser to support higher-order functions. Thus,  projects powered by Calcite such as Flink can benefit from it.

Look forward to your feedback.

Best,
Wen-hui Tang

[1] https://issues.apache.org/jira/browse/SPARK-23899
[2] https://issues.apache.org/jira/browse/SPARK-23908



winifred.wenhui.tang@xxxxxxxxx