执行jar报错 Hadoop java.io.IOException

版权声明:版权声明:本文为博主原创文章,未经博主允许不得转载。 https://blog.csdn.net/a458383896/article/details/88022719
Error: java.io.IOException: Initialization of all the collectors failed. Error in last collector was :interface junit.framework.Test
        at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:414)
        at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:81)
        at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:698)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:770)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.lang.ClassCastException: interface junit.framework.Test
        at java.lang.Class.asSubclass(Class.java:3404)
        at org.apache.hadoop.mapred.JobConf.getOutputKeyComparator(JobConf.java:887)
        at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init(MapTask.java:1004)
        at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:402)
        ... 9 more

19/02/26 09:31:03 INFO mapreduce.Job: Task Id : attempt_1551177935658_0002_m_000000_1, Status : FAILED
Error: java.io.IOException: Initialization of all the collectors failed. Error in last collector was :interface junit.framework.Test
        at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:414)
        at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:81)
        at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:698)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:770)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.lang.ClassCastException: interface junit.framework.Test
        at java.lang.Class.asSubclass(Class.java:3404)
        at org.apache.hadoop.mapred.JobConf.getOutputKeyComparator(JobConf.java:887)
        at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init(MapTask.java:1004)
        at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:402)
        ... 9 more

19/02/26 09:31:11 INFO mapreduce.Job:  map 100% reduce 0%
19/02/26 09:31:11 INFO mapreduce.Job: Task Id : attempt_1551177935658_0002_m_000000_2, Status : FAILED
Error: java.io.IOException: Initialization of all the collectors failed. Error in last collector was :interface junit.framework.Test
        at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:414)
        at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:81)
        at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:698)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:770)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.lang.ClassCastException: interface junit.framework.Test
        at java.lang.Class.asSubclass(Class.java:3404)
        at org.apache.hadoop.mapred.JobConf.getOutputKeyComparator(JobConf.java:887)
        at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init(MapTask.java:1004)
        at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:402)
        ... 9 more

初始化有问题,文本类导错,换成这个之后就可以了
import org.apache.hadoop.io.Text

猜你喜欢

转载自blog.csdn.net/a458383896/article/details/88022719