Salesforce BulkAPI problems with 6.2.0 tSalesforceBulkExec

Highlighted
One Star

Salesforce BulkAPI problems with 6.2.0 tSalesforceBulkExec

Do you have any experience using the Talend tSalesforceBulkExec component – I was using this recently and it happily creates a bulk API job and delivers batches of the source data correctly.  In fact the job runs perfectly as long as I don't try to write output or reject rows from the component.  I'm uploading about 400K records in a serial bulk api job.
If I add outputs from the tSalesforceBulkExec component, when results start to come back from the job – I always get the error below.  I’m using the latest Talend Open Studio  - 6.2.0.  When I google I see comments that this was a problem but it was fixed in version 4.x – but doesn’t look like it from my experience.
Or if there is some other way to use the BulkAPI for Salesforce in talend – could you share how you setup the jobs – maybe you used a different component in Talend?
Starting job BulkLoaderBB at 11:52 08/07/2016.
connecting to socket on port 3956
connected
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See  for further details.
Exception in component tSalesforceBulkExec_1
com.sforce.async.CSVReader$CSVParseException: Exceeded number of records : 10002. Number of records should be less than or equal to 10001
      at com.sforce.async.CSVReader.checkRecordExceptions(CSVReader.java:159)
      at com.sforce.async.CSVReader.nextRecord(CSVReader.java:189)
      at org.talend.components.salesforce.runtime.SalesforceBulkRuntime.getBaseFileRow(SalesforceBulkRuntime.java:315)
      at org.talend.components.salesforce.runtime.SalesforceBulkRuntime.getBatchLog(SalesforceBulkRuntime.java:344)
      at org.talend.components.salesforce.runtime.SalesforceBulkExecReader.advance(SalesforceBulkExecReader.java:93)
      at local_project.bulkloaderbb_0_1.BulkLoaderBB.tSalesforceBulkExec_1Process(BulkLoaderBB.java:409)
      at local_project.bulkloaderbb_0_1.BulkLoaderBB.runJobInTOS(BulkLoaderBB.java:669)
      at local_project.bulkloaderbb_0_1.BulkLoaderBB.main(BulkLoaderBB.java:526)
disconnected
 
Moderator

Re: Salesforce BulkAPI problems with 6.2.0 tSalesforceBulkExec

Hi,
Have you already checked option "Rows to commit" and "Bytes to commit" in advanced settings of tSalesforceBulkExec?
Here is a related jira issue:https://jira.talendforge.org/browse/TDI-36857

Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Agile Data lakes & Analytics

Accelerate your data lake projects with an agile approach

Watch

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download