Load SQL Server table in HIVE with tSqoopImport - How To?

One Star

Load SQL Server table in HIVE with tSqoopImport - How To?

Dear All.

I'm trying to read a SQL Server table and load it on a Hive table. I can see that tSqoopImport component can handle an ingestion phase but I cannot achieve the goal to load the data direcly in a Hive table.

I can accomplish the task outside Talend using the sqoop tool with this statement:

sqoop import --connect "jdbc:sqlserver://9.9.5.3:2012;database_name=STG"  --username myuser  -password mypassword --query "select  * from STG.dbo.MYTABLE where \$CONDITIONS" --target-dir /tmp/loadSqoop --hive-import  --create-hive-table  --hive-table testbigdata.myhivetable  --split-by myid 

But cannot find anything similar in Talend.

I've extensively searched across the community forum and googled around too with no luck

Any idea?

Is this possible or do I have to change my job behaviour?

 

Thanks

Stefano

Forteen Stars

Re: Load SQL Server table in HIVE with tSqoopImport - How To?

Hi!

 

You can import data direct into Hive table - use advanced settings of Sqoop component for additional settings, but You can not import in other than text format. So if You want import into tables in Parquet, You must:

- import into text format table

- create parquet table (tHiveRow)

- insert into new_tavble select * from old_table

 

screenshots not available because weekend and no access to Hive till Monday, but it work

-----------

Calling Talend Open Studio Users

The first 100 community members completing the Open Studio survey win a $10 gift voucher.

Start the survey

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog