I want to load data stored on Azure Data Lake Storage (Gen 1) to Azure SQL Database using talend.
Can anyone help me in this
From Talend 7.1 there is support for ADLS but this requires additional integration with Azure Databricks. Azure Databricks is a consumption-based Spark managed service that simplifies processing of Big Data and Artificial Intelligence workloads. The component is - tAzureFSConfiguration . Blog post.
But there is another way - using Powershell. Use tSystem to execute Powershell script which would export ADLS item. The export command would download a file. Once the file is downloaded to your Talend server you could use the requisite tFileInputXXX commands to read from the file and then use tMSSqlOutput components to write to database.
Two options, BD Jobs or Data Integration jobs..
For Data Integration you have info here:https://help.talend.com/reader/98wTdxOyJjhkll4BXt6Xcw/rzE1cW6_Jsslh~TM5GQ1Uw
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Part 2 of a series on Context Variables
Learn how to do cool things with Context Variables
Find out how to migrate from one database to another using the Dynamic schema