Four Stars

File limit using tDropboxList

Hello everyone,

I'd like to know if anyone has encountered this same issue.

I'm using the tDropbox components in TOS for Data Integration (I'm on version 6.3.1) for listing and downloading all files from a specific folder in my Dropbox account. The job works very well, except that it stops at exactly 2000 files (while I have slightly more: 2400 -_-) without any error being printed on the console.

I did some research on Dropbox APIs, and it seems like the http endpoint https://api.dropboxapi.com/2/files/list_folder (which I'm guessing is the one being used here) has a limit on the maximum number of files that can be retrieved in one call which is exactly 2000. I've also noticed they added an optional parameter called "limit" that can be used to set the maximum number of results to return per request (here the link to the official documentation: https://www.dropbox.com/developers/documentation/http/documentation#files-list_folder).

My question is: are there any plans to make this option available on the tDropboxList component? Alternatively, is there some way I can download all my 2400 files without using the Dropbox components?

 

Thank you for your help.

Simona

Tags (1)
1 ACCEPTED SOLUTION

Accepted Solutions
Moderator

Re: File limit using tDropboxList

Hello,

Could you please create a new feature jira issue on talend bug tracker?

https://jira.talendforge.org/secure/Dashboard.jspa

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
3 REPLIES
Moderator

Re: File limit using tDropboxList

Hello,

Could you please create a new feature jira issue on talend bug tracker?

https://jira.talendforge.org/secure/Dashboard.jspa

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Highlighted
Four Stars

Re: File limit using tDropboxList

Moderator

Re: File limit using tDropboxList

Hello,

Thanks for posting the jira link here.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.