Dynamic generation of SOQL for SalesForceInput

One Star

Dynamic generation of SOQL for SalesForceInput

Hi,
I have a scenario where I'm syncing some tables of a MySQL database with SalesForce. The table in question is a Usages table. It records a Product and where it went. I'm filtering the MySQL input by a LastModified Timestamp column, and using tMap to get the SalesForce ProductID and push it into the SalesForce Usages table. This works, but it means that the entire SalesForce Products table gets pulled (0.2 million rows) even though the MySQL input table only pulls a few hundred. Pulling that many rows from SalesForce takes a long time and chews through the API request limit.
Is there any way to use something like Product2.TheMySqlID IN (1,2,3) for the Product tables SOQL query where (1,2,3) is established from a MySQLInput?

Warm regards,
Matt

Calling Talend Open Studio Users

The first 100 community members completing the Open Studio survey win a $10 gift voucher.

Start the survey

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog