Download csv file from URL

Four Stars

Download csv file from URL

Hi,

I've been trying to create this job that extract csv file from 10 URLs but before i need to pass this authentification page, i've tried the tFileFetch and the tRestclient but nothing works ... please any suggestions

Thanks in advance

Maroua

Employee

Re: Download csv file from URL

Hi,

 

    What is the error you are getting? Could you please post screen shots of the current job flow, component screen shots and the error you are getting?

 

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved :-)

Highlighted
Four Stars

Re: Download csv file from URL

Hi nikhilthampi,

Thank you for responding i don't have an actual job schema because i'm still trying to figure out what to do, what i have in mind is two components the first one is a tRest to do the authentication job the second one is for downloading the csv file ( i'm not sure if i can use both of tRest and tfileFetch), then i can do the transformations and the loading ... 

 

The attached image is just the first component, i've linked it to a tLogRow to see the result unfortunately it returns an html code of an an intermediate page :/

 

Employee

Re: Download csv file from URL

Hi,

 

    Since yours is a special use case, I would suggest to write custom routine as it is the most easy to complete this task. If you are doing that way, you can do both tasks in single code block and integrate them to other areas.

 

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved :-)

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog