One Star

Salesforce BulkAPI problems with 6.2.0 tSalesforceBulkExec

Do you have any experience using the Talend tSalesforceBulkExec component – I was using this recently and it happily creates a bulk API job and delivers batches of the source data correctly.  In fact the job runs perfectly as long as I don't try to write output or reject rows from the component.  I'm uploading about 400K records in a serial bulk api job.
If I add outputs from the tSalesforceBulkExec component, when results start to come back from the job – I always get the error below.  I’m using the latest Talend Open Studio  - 6.2.0.  When I google I see comments that this was a problem but it was fixed in version 4.x – but doesn’t look like it from my experience.
Or if there is some other way to use the BulkAPI for Salesforce in talend – could you share how you setup the jobs – maybe you used a different component in Talend?
Starting job BulkLoaderBB at 11:52 08/07/2016.
connecting to socket on port 3956
connected
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See  for further details.
Exception in component tSalesforceBulkExec_1
com.sforce.async.CSVReader$CSVParseException: Exceeded number of records : 10002. Number of records should be less than or equal to 10001
      at com.sforce.async.CSVReader.checkRecordExceptions(CSVReader.java:159)
      at com.sforce.async.CSVReader.nextRecord(CSVReader.java:189)
      at org.talend.components.salesforce.runtime.SalesforceBulkRuntime.getBaseFileRow(SalesforceBulkRuntime.java:315)
      at org.talend.components.salesforce.runtime.SalesforceBulkRuntime.getBatchLog(SalesforceBulkRuntime.java:344)
      at org.talend.components.salesforce.runtime.SalesforceBulkExecReader.advance(SalesforceBulkExecReader.java:93)
      at local_project.bulkloaderbb_0_1.BulkLoaderBB.tSalesforceBulkExec_1Process(BulkLoaderBB.java:409)
      at local_project.bulkloaderbb_0_1.BulkLoaderBB.runJobInTOS(BulkLoaderBB.java:669)
      at local_project.bulkloaderbb_0_1.BulkLoaderBB.main(BulkLoaderBB.java:526)
disconnected
 
1 REPLY
Moderator

Re: Salesforce BulkAPI problems with 6.2.0 tSalesforceBulkExec

Hi,
Have you already checked option "Rows to commit" and "Bytes to commit" in advanced settings of tSalesforceBulkExec?
Here is a related jira issue:https://jira.talendforge.org/browse/TDI-36857

Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.