Data load using Dynamic schema (Dynamic data type in Enterprise version)

Eight Stars

Data load using Dynamic schema (Dynamic data type in Enterprise version)

I want create a generic talend job with will load data from redshift to oracle table I have around 10-15 table for now .
For example:
Table1(Redshift) -> Generic_Talend_Job -> Oracle Table 1
Table2(Redshift) -> Generic_Talend_Job -> Oracle Table 2
the metadata for each source and target are different.i.e oracle and redshift table structures are same . But table 1 structure and table 2 structure are different .
I have seen option of dynamic data type in some blogs , but not sure how to incorporate the same for my case .
Sample job screenshot and configuration will be really helpful .

Moderator

Re: Data load using Dynamic schema (Dynamic data type in Enterprise version)

Hello,

Please take a look at this troubleshooting-development topic: https://community.talend.com/t5/Troubleshooting-Development/How-to-process-changing-data-structure/t...

Let us know if it is OK with you.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Seven Stars

Re: Data load using Dynamic schema (Dynamic data type in Enterprise version)

Hi Sabrina

 

I create a question for this. https://community.talend.com/t5/Design-and-Development/How-to-use-Dynamic-schema-to-bulk-load-into-r...

 

I review your link https://community.talend.com/t5/Troubleshooting-Development/How-to-process-changing-data-structure/t.... I also manage to create one job of shipping from CSV(tFileInputDelimited) to Oracle(tOracleOutput). Do you want why it doesn't support Bulk load to readshift? (tRedshiftOutputBulkExec)

 

I test it in both 6.3.1 and 7.0.1 . 

 

Thanks,

Bin

 

 

 

 

Seven Stars

Re: Data load using Dynamic schema (Dynamic data type in Enterprise version)

Found this link https://community.talend.com/t5/Design-and-Development/Which-components-provide-the-Dynamic-Schema-f... .

I check supportDynamic.txt from both 6.3.1 and 7.0.1 . It only includes tRedshiftInput/tRedshiftOutput . Therefore, there is no support bulk upload to redshift with Dynamic schema.  Anyone can suggest how to do it DIY.

 

Thanks,

Bin

What’s New for Talend Spring ’19

Watch the recorded webinar!

Watch Now

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch

Downloads and Trials

Test drive Talend's enterprise products.

Downloads

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Download