Hi. I have a Talend Open Studio job that I inherited that posts a dataset to a webservice via HTTP post. In order to throttle the amount of data being sent to the web service, the job utilizes a tLoop to divvy up the dataset into batches of 100 records, which are then sent to a tRESTClient component to do the post (see attached screen shot). Lately, I have seen times where the web service times out. Is it possible to create logic to automatically retry the connection x number of times before timing out and killing the job? I was hoping there was a way to create the initial web service connection and putting some retry logic around that. Then, if successful, point the tRESTClient connection to the existing connection. However, it doesn't appear that this is possible. Any help is greatly appreciated!
... View more
I have a job that uses the tFileExcelWorkbookOpen and tFileExcelSheetOutput components with an xlsx template to populate a workbook and then the tSendMail component to eventually email the spreadsheet. I recently inherited this job and was tasked to add three new columns to the workbook/sheet. These three columns were already being processed by the job (they just were not being output to the workbook/sheet) so all I had to do was drag them through the job to the final tFileExcelSheetOutput component and then add them to the xlsx template. Upon running the job, the first 3300 or so rows are populated perfectly, including the three new columns that were added. However, after those 3300 rows, the three new columns are all blank all the way to the end of the report. If, however, I isolate the records with blank fields in these three new columns and only process these records through the job, all columns in the workbook/sheet, including the three new columns are populated correctly. It seems as though the workbook/sheet isn't finished being generated before it is emailed out even though I have a OnSubjobOK link between the tFileExcelSheetOutput and tSendMail components. Any help on what might be happening is appreciated. Thanks!
... View more