Salesforce data Bulk load into csv file

Highlighted
Seven Stars

Salesforce data Bulk load into csv file

Hi,

 

Is there any way to load bulk data into .csv file from Salesforce.

I tried using tSalesforceInput->tFilrOutputDelimted, but process taking too much time.

Please help me.

Sixteen Stars TRF
Sixteen Stars

Re: Salesforce data Bulk load into csv file

Hi, 

 

Did you try to select Bulk for the Query Mode of tSalesforceInput component?

Capture.PNG


TRF
Seven Stars

Re: Salesforce data Bulk load into csv file

Hi TRF,

 

I tried Bulk query mode in tSalesforceInput, but no difference.

Sixteen Stars TRF
Sixteen Stars

Re: Salesforce data Bulk load into csv file

How many records are you trying to retrieve?

How long it takes?


TRF
Seven Stars

Re: Salesforce data Bulk load into csv file

Hi TRF,

 

Job has taken 34 Minutes to fetch 4318149 Records.

Is there any other method to import bulk data from Salesforce??

Sixteen Stars TRF
Sixteen Stars

Re: Salesforce data Bulk load into csv file

Seems a little bit long, but remember you're not querying a local database (I'm sure you know that).

You can compare result using DataLoader.

Also, be sure there network is not the cause of the problem.

What if you change the schema to get only the Salesforce Id (will reduce the transfer volume)?


TRF
Seven Stars

Re: Salesforce data Bulk load into csv file

Hi TRF,

 

I am fetching only 3 columns and all those columns are required.

 

Capture.JPG

 

 

Sixteen Stars TRF
Sixteen Stars

Re: Salesforce data Bulk load into csv file

OK, so the record size is not the reason.
So can you just try using DataLoader.
It should take the same time.
Interesting to know.
Then, to be sure the network is not the reason, can you try from an other place (using an other internet connection) ?

TRF
Seven Stars

Re: Salesforce data Bulk load into csv file

Hi TRF,

 

Apologies! Since this is in Prod environment, I am unable to use Data Loader and I am a Talend developer, that's why they allowed me to use Talend in Prod env.

Anyway thanks for the help.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Self-service Talend Migration: Moving from On-Premises to the Cloud

Move from On-Premises to the Cloud by following the advice of experts

Read Now

How to deploy Talend Jobs as Docker images to Amazon, Azure and Google Cloud reg...

Learn how to deploy Talend Jobs as Docker images to Amazon, Azure and Google Cloud registries

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog