Multiple temp tables merge into main DB table

Eight Stars

Multiple temp tables merge into main DB table

Hi experts

Is there anyway to merge multiple temp tables into main redshift table?

Pls note that all temp tables have same data type and format.

Thanks
Harshal.
Employee

Re: Multiple temp tables merge into main DB table

Hi Harshal,

 

     Please refer the below stack overflow link for the same.

 

https://stackoverflow.com/questions/28413132/can-i-copy-from-one-table-to-another-in-redshift

 

   You can run the command in Talend using the component tRedhsiftRow.

 

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved :-)

Eight Stars

Re: Multiple temp tables merge into main DB table

@nikhiltampi: Thanks for your reply. I have got solution where earlier I was copying all the files into redshift table. That was taking lot of time as my files were in number 20k but very small ones like contained only 10 to 15 records.

To this alternative, I thought I could instead create temp tables instead of creating files and then put all multiple temp tables data into main redshift table. Hope this makes sense now.

The link you gave I’m aware of it. But looking for better option to improve performance of job. Although what you mentioned is correct that I can use insert into command but I have many temp tables which I want to insert into one table.
Eight Stars

Re: Multiple temp tables merge into main DB table

@nikhilthampi: I’m looking something for this sort of stuff:

https://community.talend.com/t5/Design-and-Development/Loading-multiple-table-from-source-into-multi...

The only difference is I have got multiple table to one table.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Agile Data lakes & Analytics

Accelerate your data lake projects with an agile approach

Watch