Issue with referenced view in Talend tdbrow

Four Stars

Issue with referenced view in Talend tdbrow

 

Hi all

Facing this issue w.r.t Talend jobs. 

We have a Talend job which has a T DB row component which runs the below query (Note this is not the exact query but indicative)

 

"create table abc.def as select * from abc.def_vw"

 

The underlying database is AWS Redshift. Now developers keep making changes to the underlying view. So what has been observed is that for some reason it takes the older version (SQL) or some unstable (Failing) version SQL of the view when ideally it should take that version of the view which is present at the time when this job is run.

 

Even we are a bit confused but sharing what all we have and that has been observed. Any inputs is appreciated by anyone and thanks in advance.

 

 

Four Stars

Re: Issue with referenced view in Talend tdbrow

Also one more point which I forgot to add is that this job is scheduled and fails during the scheduled run. If I were to re run the job after that manually or rebuild the parent job it is ok and takes the latest valid SQL for the job. 

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog