I'm trying to create Hive external table using talend data fabric 7.1.1 but although I gave avro.schema.url the table creation is throwing an error "at least one column must be specified for the table". I have .avsc file kept at the avro.schema.url location.
I'm using thivecreatetable component with create external table box checked, built in schema is empty 'cuz I want to retrieve it from .avsc file located at avro.schema.url.
Table Properties value
Could somebody help please?
We currently don't have a way in the Studio to automate getting the Avro Schema from a file, especially on HDFS.
To do it manually, please have a look at avro-tools (see http://www.michael-noll.com/blog/2013/03/17/reading-and-writing-avro-files-from-the-command-line/ for a good tutorial).
There's a "getschema" command, but it requires the avro file to be on the local filesystem. This is probably the best way to do it for one or two tables.
Please refer to this new feature jira issue:https://jira.talendforge.org/browse/TBD-5870
Even if I get schema retrieved from avro file, my question is how do I create external table based on the .avsc file, which is not working with tHiveCreateTable component? what is the best way to create external table based on .avsc file?
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Learn how to make your data more available, reduce costs and cut your build time
Read about OTTO's experiences with Big Data and Personalized Experiences
Take a look at this video about Talend Integration with Databricks