Four Stars

Talend components support forHive avro table with complex data types

Q1: We have a complex xml that we have to parse and loaded into an Hive Avro table with complex data types. The tAvroInput component does not support this. What other options do we have in Talend to do this.
Q2: Assume we write are able to put the data into the Hive Avro table with complex data types (either using talend or custom code), we can use tHiveInput to read the data from the table, however we cannot write back to a Hive Avro table with complex data types. What options we have in Talend to write the data.
Please share your views on approaching this scenario using Talend
1 REPLY
Employee

Re: Talend components support forHive avro table with complex data types

About Q1, you might want to consider the Talend Data Mapper, it supports transforming XML to Avro. In the current version (6.1.1), this runs in regular DI job. In the upcoming 6.2.0, this will also run in a Spark job.