Pushing Talend job execution to google data engine(Dataflow)

[mitra]

Hi,

Is it possible to build talend etl job and push the execution to google dataflow or google cloud ?

Please share some useful link.

Thanks.

[lbride · Accepted solution]

Hello,

With the Summer 17' release, using the Talend Studio Big Data edition, you have the ability to build Spark Jobs and push them to Google DataProc. 

There is no support for Google DataFlow with Talend's current products BUT it will come through Apache Beam in our future releases. The first product that will support Google DataFlow runtime will be Data Streams which will come in 2018.

Best,

Laurent

[xdshi]

Hello,

We have redirected your issue to our expert and then come back to you as soon as we can.

Best regards

Sabrina

[lbride · Accepted solution]

Hello,

With the Summer 17' release, using the Talend Studio Big Data edition, you have the ability to build Spark Jobs and push them to Google DataProc. 

There is no support for Google DataFlow with Talend's current products BUT it will come through Apache Beam in our future releases. The first product that will support Google DataFlow runtime will be Data Streams which will come in 2018.

Best,

Laurent