Talend Integration with SharePoint

Six Stars

Talend Integration with SharePoint

We currently have a number of integrations where we pull/push data to/from NAS drives throughout the company. As part of our strategic direction - NAS drives are being migrated to O365 SharePoint locations. This means our Talend jobs will need the ability to connect to, pull down from; push to; and delete from  - O365 SharePoint sites. I've googled everything related to this and there's not a clear-cut, easy solution - i.e. you don't just drop the "tFileList" component on your workflow and have access to the files. :-)

 

I wanted to get other people's thoughts/input into the "Best" way to achieve access to SharePoint files via Talend. Have people use Third Party software/controls? Have people developed Java or C# services and called those from Talend? Have people used tSOAP to connect to SharePoint (i.e. Copy.asmx) and what  was your experience like? Could you access/remove/deliver data files easily from/to SharePoint with any of these methods? 

 

It's a general question to see what others have experienced.

 

Thanks for any input on this.

Employee

Re: Talend Integration with SharePoint

Hi,

 

     There are no direct components to process the data in SHarepoint. But you can use Talend SOAP/REST components to interact with Sharepoint.

 

     I also noticed two third party blogs abouth integration between Talend and SHarepoint. Could you please try these?

 

https://www.cdata.com/kb/tech/sharepoint-jdbc-talend.rst

 

https://www.datalytyx.com/how-to-extract-list-items-from-sharepoint-on-premise-into-talend-gated/

 

    Another way is to create the custom component or routine in Talend for your specific need to integrate between Talend and Sharepoint.

 

Warm Regards,

 

Nikhil Thampi

 

 

Six Stars

Re: Talend Integration with SharePoint

Thanks...I've actually been to these 2 links over the past 2 days...and also am exploring a custom component. 

 

I'm looking for an easy solution - and there doesn't appear to be any. I'm not a big fan of picking up and dropping data files used for ETL work on a SharePoint site....but it looks like that's the solution I'm going to have to develop. SharePoint - in my opinion - just makes everything more difficult for automated processes like this.

 

Thanks for the input - much appreciated!

Four Stars

Re: Talend Integration with SharePoint

Hi @JBristow 

 

Did you end up finding a solution to this issue as I am exploring a solution to the same problem.

 

I need to download one / multiple files from Sharepoint Document Library using Talend.

 

I have tried various components like tFileFetch and tHttpRequest however, both of them generate 403 forbidden error so haven't found a solution as yet.

 

Can you please share your experience on how you solved this?

 

Regards

Raminder

Six Stars

Re: Talend Integration with SharePoint

We aren't downloading from SharePoint at this time. We may revisit in the near future - but at this time any data files needed for Talend processing are required to be dropped to a NAS location we can access. One Drive is basically a NAS - so at some point we'll need to work with our SharePoint Team to figure out if this is possible.

One Star

Re: Talend Integration with SharePoint

Hi, my 2 cents

as i never found a solution to push directly xlsx databases exports from talend to Sharepoint O365 collaboration site, i simply connected a Win server to the library of the sharepoint site with onedrive, shared this local folder, and push xlsx to this location.

one drive upload to the O365 library and my users are notifyed that there is a new file on the collaboration site.

 

Its a prety dirty way, but i didnt find another :/

 

WW

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog