I am looking for guidance, if the following routine can be automatized in Talend?
I have multiple Redshift tables, which are already containing billions of records, but sometimes I need to add new columns. All of the added columns should be NOT NULL and it must not have a default value. The workaround that we currently have, is that we implement the new columns with NOT NULL and a default value, then we are populating the column with data, after that we are creating a new table with the same columns, but without the default value, then we are loading everything from the source table to the newly created one, then we are dropping the original table, and renaming the newly created table.
So the steps are the following:
Is it possible to automatize this procedure?
Could you please elaborate your case with an example with input and expected output values?
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Learn how to do cool things with Context Variables
Find out how to migrate from one database to another using the Dynamic schema
Pick up some tips and tricks with Context Variables