Six Stars

Salesforce data Bulk load into csv file

Hi,

 

Is there any way to load bulk data into .csv file from Salesforce.

I tried using tSalesforceInput->tFilrOutputDelimted, but process taking too much time.

Please help me.

8 REPLIES
Twelve Stars TRF
Twelve Stars

Re: Salesforce data Bulk load into csv file

Hi, 

 

Did you try to select Bulk for the Query Mode of tSalesforceInput component?

Capture.PNG


TRF
Six Stars

Re: Salesforce data Bulk load into csv file

Hi TRF,

 

I tried Bulk query mode in tSalesforceInput, but no difference.

Twelve Stars TRF
Twelve Stars

Re: Salesforce data Bulk load into csv file

How many records are you trying to retrieve?

How long it takes?


TRF
Six Stars

Re: Salesforce data Bulk load into csv file

Hi TRF,

 

Job has taken 34 Minutes to fetch 4318149 Records.

Is there any other method to import bulk data from Salesforce??

Twelve Stars TRF
Twelve Stars

Re: Salesforce data Bulk load into csv file

Seems a little bit long, but remember you're not querying a local database (I'm sure you know that).

You can compare result using DataLoader.

Also, be sure there network is not the cause of the problem.

What if you change the schema to get only the Salesforce Id (will reduce the transfer volume)?


TRF
Six Stars

Re: Salesforce data Bulk load into csv file

Hi TRF,

 

I am fetching only 3 columns and all those columns are required.

 

Capture.JPG

 

 

Twelve Stars TRF
Twelve Stars

Re: Salesforce data Bulk load into csv file

OK, so the record size is not the reason.
So can you just try using DataLoader.
It should take the same time.
Interesting to know.
Then, to be sure the network is not the reason, can you try from an other place (using an other internet connection) ?

TRF
Six Stars

Re: Salesforce data Bulk load into csv file

Hi TRF,

 

Apologies! Since this is in Prod environment, I am unable to use Data Loader and I am a Talend developer, that's why they allowed me to use Talend in Prod env.

Anyway thanks for the help.