trest, trestclient, thttprequest differences

Seven Stars

trest, trestclient, thttprequest differences

Hi Team,

 

please provide your inputs, what is the exact difference between trest, trestclient, thttprequest using Talend DI to achieve the scenario to read files from http robot and load the data to postgres tables.

 trest, trestclient, thttprequest among these which components are feasible to use, or any other suggestions please provide your inputs

 

Regards,

Meena


Accepted Solutions
Highlighted
Ten Stars

Re: trest, trestclient, thttprequest differences

You mean in terms of scraping websites?
Could you please elaborate ... what are you trying to achieve?

All Replies
Highlighted
Ten Stars

Re: trest, trestclient, thttprequest differences

You mean in terms of scraping websites?
Could you please elaborate ... what are you trying to achieve?
Seven Stars

Re: trest, trestclient, thttprequest differences

Hi Dijke,
I have scenario to download files by logging into 3rd party website for example https://www.trans.com/tg/vision and load the data to postgres to achieve this what are the components or approaches suggestible in Talend DI kindly help
Ten Stars

Re: trest, trestclient, thttprequest differences

Recommend using tSystem with cUrl , install it on the o.s..
in tSystem call it like this (String[]{"bash","-c", "curl ....commands...... "}
Or if its real scraping (like html data) Selenium with Python.
Store it in a file and then read it with tFileInputDelimited -> tMap -> tPostgresOutput

Cloud Free Trial

Try Talend Cloud free for 30 days.

Tutorial

Introduction to Talend Open Studio for Data Integration.

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.