Loading data from ADLS(Azure Gen1) to Azure SQL database using talend

Highlighted
Four Stars

Loading data from ADLS(Azure Gen1) to Azure SQL database using talend

hi,

I  want to load data stored on Azure Data Lake Storage (Gen 1) to Azure SQL Database using talend.

Can anyone help me in this

Nine Stars

Re: Loading data from ADLS(Azure Gen1) to Azure SQL database using talend

From Talend 7.1 there is support for ADLS but this requires additional integration with Azure Databricks. Azure Databricks is a consumption-based Spark managed service that simplifies processing of Big Data and Artificial Intelligence workloads. The component is - tAzureFSConfiguration . Blog post.
But there is another way - using Powershell. Use tSystem to execute Powershell script which would export ADLS item. The export command would download a file. Once the file is downloaded to your Talend server you could use the requisite tFileInputXXX commands to read from the file and then use tMSSqlOutput components to write to database.

Four Stars

Re: Loading data from ADLS(Azure Gen1) to Azure SQL database using talend

Thanks.

I will Check

Employee

Re: Loading data from ADLS(Azure Gen1) to Azure SQL database using talend

Two options, BD Jobs or Data Integration jobs..

 

For Data Integration you have info here:https://help.talend.com/reader/98wTdxOyJjhkll4BXt6Xcw/rzE1cW6_Jsslh~TM5GQ1Uw

For BD/Spark:https://help.talend.com/reader/vL1PhaFdyq7wvci0YX83pg/Xock9DFqZ7AMN_ZgzqOeuA

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog