From Thursday, July, 9, 3:00 PM Pacific,
our Community site will be in
read-only mode
through Sunday, July 12th.
Thank you for your patience.

How to deal with flat file downloads in Integration Cloud?

Highlighted
Six Stars

How to deal with flat file downloads in Integration Cloud?

Hi folks,

 

We just purchased Talend Integration Cloud and I am working to migrate a job I've created in regular studio on my PC and then ran using Windows Scheduler.

 

The job imported a .csv file from an SFTP server, deposited it into a folder on the PC, then did work on it, and uploaded it elsewhere.

 

But when I host a job on Integration Cloud, there is no folder for me to download to, and I can't access my flat files without downloading them first to a location it seems.

 

I know this must be basic for many, but what should I do?


Accepted Solutions
Highlighted
Six Stars

Re: How to deal with flat file downloads in Integration Cloud?

Shong,

 

I was able to resolve this using an answer you gave to another question.

 

Thank you.

View solution in original post


All Replies
Highlighted
Community Manager

Re: How to deal with flat file downloads in Integration Cloud?

Hi
You can download it to location on server , such as "/tmp/" , and delete the file in the end of job, check the file if it exists and delete it.

tpostJob--oncomponentok-->tFileExist--runif--tFileDelete

Regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
Highlighted
Six Stars

Re: How to deal with flat file downloads in Integration Cloud?

Hi Shong,

 

So I went to try this out by going to my local job and changing the local directory from "C:/xxxx/yyy.csv" to "/tmp/yyy.csv" in the tFTPGet, and all subsequent components.

 

But I got the error that "The system cannot find the file specified".

 

Am I using the wrong component?

 

 

Highlighted
Six Stars

Re: How to deal with flat file downloads in Integration Cloud?

Shong,

 

I was able to resolve this using an answer you gave to another question.

 

Thank you.

View solution in original post

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Talend Cloud Developer Series – Defining Metadata

This video focuses on different methods of adding metadata to a job in Talend Cloud

Watch Now

Talend Cloud Developer Series – Updating Context Variables

This video will show you how to add context parameters to a job in Talend Cloud

Watch Now

Talend Cloud Developer Series – Deploying First Job to Cloud

This video will show you how to run a job in Studio and then publish that job to Talend Cloud

Watch Now