'java.lang.NoSuchMethodError' error when running a Talend Spark v. 6.4.1 Job with a tHbase component against Hortonworks Data Platform 2.6

Problem Description

When running a Talend version 6.4.1 Spark Job with a tHbaseInput component and Spark version 2.1, the Job fails against Hortonworks Data Platform (HDP) version 2.6, with the following exception:

Caused by: java.lang.NoSuchMethodError: io.netty.channel.DefaultFileRegion.<init>(Ljava/io/File;JJ)V
	at org.apache.spark.network.buffer.FileSegmentManagedBuffer.convertToNetty(FileSegmentManagedBuffer.java:133)
	at org.apache.spark.network.protocol.MessageEncoder.encode(MessageEncoder.java:58)
	at org.apache.spark.network.protocol.MessageEncoder.encode(MessageEncoder.java:33)
	at io.netty.handler.codec.MessageToMessageEncoder.write(MessageToMessageEncoder.java:89)


Root Cause

This issue is due to an inadequate netty-all dependency library version.



You can correct this issue by upgrading to Talend Studio version 6.4.2 or 6.5.1. If you are using Talend Studio version 6.4.1, contact Talend Support for Patch_20170804_TPS-2066_v1_6.4.1 and follow the installation instructions in the included text file.

Version history
Revision #:
10 of 10
Last update:
‎02-24-2019 11:11 PM
Updated by: