Salesforce data Bulk load into csv file

Highlighted
Seven Stars

Salesforce data Bulk load into csv file

Hi,

 

Is there any way to load bulk data into .csv file from Salesforce.

I tried using tSalesforceInput->tFilrOutputDelimted, but process taking too much time.

Please help me.

Highlighted
Sixteen Stars
Sixteen Stars

Re: Salesforce data Bulk load into csv file

Hi, 

 

Did you try to select Bulk for the Query Mode of tSalesforceInput component?

Capture.PNG


TRF
Highlighted
Seven Stars

Re: Salesforce data Bulk load into csv file

Hi TRF,

 

I tried Bulk query mode in tSalesforceInput, but no difference.

Highlighted
Sixteen Stars
Sixteen Stars

Re: Salesforce data Bulk load into csv file

How many records are you trying to retrieve?

How long it takes?


TRF
Highlighted
Seven Stars

Re: Salesforce data Bulk load into csv file

Hi TRF,

 

Job has taken 34 Minutes to fetch 4318149 Records.

Is there any other method to import bulk data from Salesforce??

Highlighted
Sixteen Stars
Sixteen Stars

Re: Salesforce data Bulk load into csv file

Seems a little bit long, but remember you're not querying a local database (I'm sure you know that).

You can compare result using DataLoader.

Also, be sure there network is not the cause of the problem.

What if you change the schema to get only the Salesforce Id (will reduce the transfer volume)?


TRF
Highlighted
Seven Stars

Re: Salesforce data Bulk load into csv file

Hi TRF,

 

I am fetching only 3 columns and all those columns are required.

 

Capture.JPG

 

 

Highlighted
Sixteen Stars
Sixteen Stars

Re: Salesforce data Bulk load into csv file

OK, so the record size is not the reason.
So can you just try using DataLoader.
It should take the same time.
Interesting to know.
Then, to be sure the network is not the reason, can you try from an other place (using an other internet connection) ?

TRF
Highlighted
Seven Stars

Re: Salesforce data Bulk load into csv file

Hi TRF,

 

Apologies! Since this is in Prod environment, I am unable to use Data Loader and I am a Talend developer, that's why they allowed me to use Talend in Prod env.

Anyway thanks for the help.

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Talend Cloud Developer Series - Introduction

The Talend Cloud Developer Series was created to give you a solid foundational understanding of Talend’s Cloud Integration Platform

Watch Now

Talend Cloud Available on Microsoft Azure

An integration platform-as-a-serviceto help enterprises collect, govern, transform, and share data from any data sources

Watch Now

Self-service Talend Migration: Moving from On-Premises to the Cloud

Move from On-Premises to the Cloud by following the advice of experts

Read Now