git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Generate Beam Pipeline from JSON


I would mention two other options to keep in mind:

 - In Python, the driver program can be tiny (much smaller than JSON probably)
 - Beam SQL (tied to the Java SDK) is experimenting with a SQL shell/CLI. It is not quite done, but you could follow https://issues.apache.org/jira/browse/BEAM-3773.

Kenn

On Fri, May 25, 2018 at 8:51 AM Jean-Baptiste Onofré <jb@xxxxxxxxxxxx> wrote:
Hi,

That's on the Declarative DSLs scope: XML and JSON.

It's not yet ready but it's a work in progress.

You can follow:

https://issues.apache.org/jira/browse/BEAM-14

Regards
JB

On 25/05/2018 17:15, S. Sahayaraj wrote:
> Hello,
>
>                 I would like to create the Beam pipeline (in Java) from
> the definitions given in JSON file. Is there any Beam Compiler
> available? Is any specification that guides me on how to do it?  I don’t
> want to write the driver program for every pipeline. Please suggest.
>
>  
>
> Cheers,
>
> S. Sahayaraj
>

--
--
Jean-Baptiste Onofré
jbonofre@xxxxxxxxxx
http://blog.nanthrax.net
Talend - http://www.talend.com