Talend DI 6.4.1 PostgrSQL (RDS AWS) dynamic schema?

Highlighted
Seven Stars

Talend DI 6.4.1 PostgrSQL (RDS AWS) dynamic schema?

Hello everyone,

 

I am aware of Dynamic Schema feature in Talend DI as per this article usign MySQL input database.

 

https://community.talend.com/t5/Troubleshooting-Development/How-to-process-changing-data-structure/t...

 

Howver, I am not able to get this feature working in PostgreSQL RDS AWS (PostgreSQL 9.6.x).

The "Dynamic" does not exist in the drop-down list in Edit Schema dialog under Type.

I am using the "Free" edition of Talend DI version 6.4.1 on Windows 10 64-bit.

 

Does anyone know if this feature is supported and if so how I can make it work on PostgreSQL RDS on AWS ?

Perhaps I need a different JDBC driver version installed in Talend (how?).

 

I have a simple requirement like so:

 

To write and use one single generic Talend job to copy data from any number of PostgreSQL RDS AWS database tables into a file per table or S3 object per table as output.

I don't need any transformations, I just need to get the data out into a delimited file format for loading into Redshift.

 

It looks like Dynamic Schema would be ideal for it, if it worked in AWS PostgreSQL RDS.

 

Thanks

 


Accepted Solutions
Eight Stars

Re: Talend DI 6.4.1 PostgrSQL (RDS AWS) dynamic schema?

dynamic schema feature is available only in Talend Enterprise Edition not on Open Studio.. 

View solution in original post


All Replies
Eight Stars

Re: Talend DI 6.4.1 PostgrSQL (RDS AWS) dynamic schema?

dynamic schema feature is available only in Talend Enterprise Edition not on Open Studio.. 

View solution in original post

Seven Stars

Re: Talend DI 6.4.1 PostgrSQL (RDS AWS) dynamic schema?

many thanks,

it appears that writing a Java/JDBC Generic-Table-Unload library and plugging it into "free" Talend DI would be the next best option?

Opinions? Thoughts?

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog