trest, trestclient, thttprequest differences

Seven Stars

trest, trestclient, thttprequest differences

Hi Team,

 

please provide your inputs, what is the exact difference between trest, trestclient, thttprequest using Talend DI to achieve the scenario to read files from http robot and load the data to postgres tables.

 trest, trestclient, thttprequest among these which components are feasible to use, or any other suggestions please provide your inputs

 

Regards,

Meena


Accepted Solutions
Ten Stars

Re: trest, trestclient, thttprequest differences

You mean in terms of scraping websites?
Could you please elaborate ... what are you trying to achieve?

View solution in original post


All Replies
Ten Stars

Re: trest, trestclient, thttprequest differences

You mean in terms of scraping websites?
Could you please elaborate ... what are you trying to achieve?

View solution in original post

Seven Stars

Re: trest, trestclient, thttprequest differences

Hi Dijke,
I have scenario to download files by logging into 3rd party website for example https://www.trans.com/tg/vision and load the data to postgres to achieve this what are the components or approaches suggestible in Talend DI kindly help
Ten Stars

Re: trest, trestclient, thttprequest differences

Recommend using tSystem with cUrl , install it on the o.s..
in tSystem call it like this (String[]{"bash","-c", "curl ....commands...... "}
Or if its real scraping (like html data) Selenium with Python.
Store it in a file and then read it with tFileInputDelimited -> tMap -> tPostgresOutput

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog