I am working in talend big data using one month license package. In this package there is no tHiveOutput component. so am using tHiveLoad component in my talend job for data loading from hadoop to hive.
I am getting data from Mssql then loaded into hadoop layer using text file format, then loaded data from hadoop to hive. This is talend job flow.
I have facing issue while loading data from hadoop to hive getting extra records. In tHDFSOutput component using field separator tilde(~) symbol and row separator \n. In tHiveLoad component also using field separator tilde(~) symbol and row separator \n. I have tried lot methods unable to find the solution for this issue.
Kindly share information as soon as earliest.
for example :
Mssql table count : 1000
Hive table count : 1010
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Learn how to make your data more available, reduce costs and cut your build time
Read about OTTO's experiences with Big Data and Personalized Experiences
Pick up some tips and tricks with Context Variables