Where does data preparation executes when using a Remote Engine?

Highlighted
Five Stars

Where does data preparation executes when using a Remote Engine?

Hi,

 

I have a bunch of CSV files stored in Azure Data Lake that I want to be able to run a data preparation on...

Since all of our architecture is isolated on a private network it is mandatory to use the Remote Engine. Does this means that the data preparation will have to download the file from the Azure Data Lake to the Remote Engine server and then upload it again?

 

This will add so much extra network overhead.


Thank you

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Self-service Talend Migration: Moving from On-Premises to the Cloud

Move from On-Premises to the Cloud by following the advice of experts

Read Now