[resolved] Calling paginated REST API

One Star

[resolved] Calling paginated REST API

Hi,
I have 2 questions - 
1) First can we directly use the REST response (XML/JSON data) and parse its contents?
2) I have to call a REST api which has paginated response. So would need to call till all the data is exhausted. How can we achieve the same.
-Manoj

Accepted Solutions
Community Manager

Re: [resolved] Calling paginated REST API

1) Yes you can. This is very simple with Talend.....simpler with XML than JSON though.
2) Paginated responses can be a bit fiddly, but entirely possible. I have actually written a tutorial about how to get Spotify listening stats from Facebook, that has to deal with a REST service making use of paginated results. My tutorial can be found here. It is probably more complicated than your job will need to be, but should give you a good idea of how to deal with getting all of the REST response pages. You can download the job at the bottom of the tutorial and if you have Facebook with a Spotify account linked, can make use of it.
Hope it helps

All Replies
Community Manager

Re: [resolved] Calling paginated REST API

1) Yes you can. This is very simple with Talend.....simpler with XML than JSON though.
2) Paginated responses can be a bit fiddly, but entirely possible. I have actually written a tutorial about how to get Spotify listening stats from Facebook, that has to deal with a REST service making use of paginated results. My tutorial can be found here. It is probably more complicated than your job will need to be, but should give you a good idea of how to deal with getting all of the REST response pages. You can download the job at the bottom of the tutorial and if you have Facebook with a Spotify account linked, can make use of it.
Hope it helps
One Star

Re: [resolved] Calling paginated REST API

Thanks a lot. This helped.
Five Stars

Re: [resolved] Calling paginated REST API

Page is not open.
Five Stars

Re: [resolved] Calling paginated REST API

Is the tutorial still online somewhere? 

Seven Stars

Re: [resolved] Calling paginated REST API

@rhall_2_0 : Your tutorial is not available. Could you please share the updated link. This might help me in fixing my Pagination issue for Rally

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog