[resolved] Taland-BigdataBatchjob-Mapreduce is throwing an error

Six Stars

[resolved] Taland-BigdataBatchjob-Mapreduce is throwing an error

java.lang.IllegalArgumentException: Unable to parse '/hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework' as a URI, check the setting for mapreduce.application.framework.path
 
at org.apache.hadoop.mapreduce.JobSubmitter.addMRFrameworkToDistributedCache(JobSubmitter.java:443)

at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:142)

at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)

at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:422)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)

at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)

at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:575)

at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:570)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:422)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)


disconnected

at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:570)

at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:561)

at org.talend.hadoop.mapred.lib.MRJobClient.runJob(MRJobClient.java:58)

at hls_hdap.howto_mapreduce_ex1_0_1.Howto_MapReduce_Ex1.runMRJob(Howto_MapReduce_Ex1.java:1911)

at hls_hdap.howto_mapreduce_ex1_0_1.Howto_MapReduce_Ex1.tHDFSInput_1Process(Howto_MapReduce_Ex1.java:1725)

at hls_hdap.howto_mapreduce_ex1_0_1.Howto_MapReduce_Ex1.run(Howto_MapReduce_Ex1.java:1879)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)

at hls_hdap.howto_mapreduce_ex1_0_1.Howto_MapReduce_Ex1.runJobInTOS(Howto_MapReduce_Ex1.java:1818)

at hls_hdap.howto_mapreduce_ex1_0_1.Howto_MapReduce_Ex1.main(Howto_MapReduce_Ex1.java:1797)

Caused by: java.net.URISyntaxException: Illegal character in path at index 11: /hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework

at java.net.URI$Parser.fail(URI.java:2848)

at java.net.URI$Parser.checkChars(URI.java:3021)

at java.net.URI$Parser.parseHierarchical(URI.java:3105)

at java.net.URI$Parser.parse(URI.java:3063)

at java.net.URI.<init>(URI.java:588)

at org.apache.hadoop.mapreduce.JobSubmitter.addMRFrameworkToDistributedCache(JobSubmitter.java:441)

... 21 more

Accepted Solutions
Six Stars

Re: [resolved] Taland-BigdataBatchjob-Mapreduce is throwing an error

This error was resolved by hardcode the actual version . this has to be set up in hadoop properties in Hadoop configuration settings.
  "mapreduce.applicaiton.framework.path" = "hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework"
${hdp.version}=actual version like 2.5.0.0-1245

All Replies
Six Stars

Re: [resolved] Taland-BigdataBatchjob-Mapreduce is throwing an error

This error was resolved by hardcode the actual version . this has to be set up in hadoop properties in Hadoop configuration settings.
  "mapreduce.applicaiton.framework.path" = "hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework"
${hdp.version}=actual version like 2.5.0.0-1245