Error while running my big data application NPE

Seven Stars

Error while running my big data application NPE

Hi,
Here i'm basically running a small application which will fetch data from a hbase table, and apply some transformations on it and write the output as a parquet file in HDFS.
tHbaseInput >> tMap >> tFileOutputParquet

I can build the jar with out any errors but while running the job with a .sh script in the cluster, i'm facing these exceptions.

Running job: job_1472265299867_8850
 map 0% reduce 0%
Task Id : attempt_1472265299867_8850_m_000001_0, Status : FAILED
Error: java.lang.NullPointerException
        at parquet.io.api.Binary.fromString(Binary.java:211)
        at parquet.example.data.Group.append(Group.java:106)
        at local_project.karthik_test_1_0_1.Karthik_Test_1$TalendParquetOutputMapper_tFileOutputParquet_1_Mapper_1.map(Karthik_Test_1.java:15991)
        at local_project.karthik_test_1_0_1.Karthik_Test_1$TalendParquetOutputMapper_tFileOutputParquet_1_Mapper_1.map(Karthik_Test_1.java:1)
        at org.talend.hadoop.mapred.lib.Chain$ChainOutputCollector.collect(Chain.java:462)
        at local_project.karthik_test_1_0_1.Karthik_Test_1$tMap_1Mapper.map(Karthik_Test_1.java:15816)
        at local_project.karthik_test_1_0_1.Karthik_Test_1$tMap_1Mapper.map(Karthik_Test_1.java:1)
        at org.talend.hadoop.mapred.lib.ChainMapper.map(ChainMapper.java:63)
        at org.talend.hadoop.mapred.lib.DelegatingMapper.map(DelegatingMapper.java:44)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:435)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1566)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)


1. I have kept all the fields as  nullable , but used this as a  default value "" for string.
2.Which default values should i assign for the empty fields of other data types?? (date,Integer etc..) These might cause the NPE.
But the rest of the errors i cant understand. How to resolve these?
Please help me out.
Thanks in advance.
Moderator

Re: Error while running my big data application NPE

Hi,
What's the build version you are using?
Could you please show us your job setting screenshots which will be helpful for us to address your issue.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

What’s New for Talend Spring ’19

Watch the recorded webinar!

Watch Now

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch

Downloads and Trials

Test drive Talend's enterprise products.

Downloads