Six Stars

trest, trestclient, thttprequest differences

Hi Team,

 

please provide your inputs, what is the exact difference between trest, trestclient, thttprequest using Talend DI to achieve the scenario to read files from http robot and load the data to postgres tables.

 trest, trestclient, thttprequest among these which components are feasible to use, or any other suggestions please provide your inputs

 

Regards,

Meena

1 ACCEPTED SOLUTION

Accepted Solutions
Nine Stars

Re: trest, trestclient, thttprequest differences

You mean in terms of scraping websites?
Could you please elaborate ... what are you trying to achieve?
3 REPLIES
Nine Stars

Re: trest, trestclient, thttprequest differences

You mean in terms of scraping websites?
Could you please elaborate ... what are you trying to achieve?
Six Stars

Re: trest, trestclient, thttprequest differences

Hi Dijke,
I have scenario to download files by logging into 3rd party website for example https://www.trans.com/tg/vision and load the data to postgres to achieve this what are the components or approaches suggestible in Talend DI kindly help
Nine Stars

Re: trest, trestclient, thttprequest differences

Recommend using tSystem with cUrl , install it on the o.s..
in tSystem call it like this (String[]{"bash","-c", "curl ....commands...... "}
Or if its real scraping (like html data) Selenium with Python.
Store it in a file and then read it with tFileInputDelimited -> tMap -> tPostgresOutput