Facing this issue w.r.t Talend jobs.
We have a Talend job which has a T DB row component which runs the below query (Note this is not the exact query but indicative)
"create table abc.def as select * from abc.def_vw"
The underlying database is AWS Redshift. Now developers keep making changes to the underlying view. So what has been observed is that for some reason it takes the older version (SQL) or some unstable (Failing) version SQL of the view when ideally it should take that version of the view which is present at the time when this job is run.
Even we are a bit confused but sharing what all we have and that has been observed. Any inputs is appreciated by anyone and thanks in advance.
Also one more point which I forgot to add is that this job is scheduled and fails during the scheduled run. If I were to re run the job after that manually or rebuild the parent job it is ok and takes the latest valid SQL for the job.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Part 2 of a series on Context Variables
Learn how to do cool things with Context Variables
Find out how to migrate from one database to another using the Dynamic schema