I am running a job which has a tmssql input and one tmssql output component.
After running for few minitues my job gets failed with below error.
I am using Talend Enterprise BigData 5.6.1.
Checked with Database Team there is no Tunnel down or connection drop happening at that time.
Exception in component tMSSqlInput_1
java.sql.SQLException: Invalid state, the Statement object is closed.
Depends of your job design, but you have to know that if you're reading the result set of a Select statement and try to engage a transaction (an update for example), the cursor associated to the result set will be closed.
As a turnover, try to have 2 separated connections (1 for select, 1 for update).
Thanks for the reply.
I am reading from a different database and writing in another. So there are two seperate connections created.
Also there is no update used just read from source and then truncate load in target.
Yes it may work if batch size is reduced but my job pulls about half a million records so it would run for several hours.
currently my batch size is 10000 and it takes around 3 hrs to complete.
I too faced the same issue and reducing batch size and running is the temporary solution only.
I have also asked for the permanent solution.