Load data from S3 to PostGres

Four Stars

Load data from S3 to PostGres

Hi, 
I would like to know a sample pipeline to load data from S3 to PostGres and MySql servers.
Thanks
Moderator

Re: Load data from S3 to PostGres

Hi,
Here are tS3XXX and tPostgresqlXXX components in talend.
You can use ts3get component to retrieve data from Amazon s3 and then load them into postgresql DB.
The work flow should be: tS3xxx-->tpostgresqloutput
                                               -->tmysqloutput
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Four Stars

Re: Load data from S3 to PostGres

Thank you Sabrina,
This is useful, one query is that using ts3put , do we need to write it to a file server before we use tpostgresqloutput / tmysqloutput or would tpostgresqloutput/tmysqloutput be able to consume it directly from ts3put.
Regards,
Srivignesh KN
Four Stars

Re: Load data from S3 to PostGres

Hi Sabrina, 
Thanks for the reply.
My use case is to load data from S3 to PostGres and i am trying to read an existing file from S3 bucket and load it into PostGres DB.
However, i see the description of the tS3_Put connector is to load data into S3.
The connector also asks for the file name to be uploaded as a mandated input (Highlighted in the Picture). I would like to understand how we would be able to read file from an existing bucket from S3 and load to PostGres/Mysql.
Thank you for your time on this, please do let me know if you require any additional details.
Regards,
Srivignesh KN
Moderator

Re: Load data from S3 to PostGres

Hi,
You need to use tS3Get component in your use case which is used to retrieve a file from Amazon S3.
https://help.talend.com/search/all?query=tS3Get&content-lang=en

Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.