Windows环境下Hadoop 3.2.4运行WordCount任务失败求助
Windows下Hadoop 3.2.4 WordCount任务执行失败排查请求
在Windows环境运行Hadoop 3.2.4版本,尝试执行hadoop/share/hadoop/mapreduce/share/mapreduce-examples-3.2.4.jar中的WordCount任务时失败,报错信息如下:
Application application_1699601027477_0002 failed 2 times due to AM Container for appattempt_1699601027477_0002_000002 exited with exitCode: 1 Failing this attempt.Diagnostics: [2023-11-10 14:44:16.479]Exception from container-launch. Container id: container_1699601027477_0002_02_000001 Exit code: 1 Exception message: '/tmp/hadoop-ryan' is not recognized as an internal or external command, operable program or batch file. [2023-11-10 14:44:16.479]Container exited with a non-zero exit code 1. [2023-11-10 14:44:16.479]Container exited with a non-zero exit code 1. For more detailed output, check the application tracking page: http://LAPTOP-IPDKGW12:8088/cluster/app/application_1699601027477_0002 Then click on links to logs of each attempt. . Failing the application.
当前配置文件设置
core-site.xml
<configuration> <property> <name>fs.defaultFS</name> <value>hdfs://localhost:9000</value> </property> </configuration>
hdfs-site.xml
<configuration> <property> <name>dfs.replication</name> <value>1</value> </property> <property> <name>dfs.namenode.name.dir</name> <value>C:\hadoop\data\namenode</value> </property> <property> <name>dfs.datanode.data.dir</name> <value>C:\hadoop\data\datanode</value> </property> </configuration>
mapred-site.xml
<configuration> <property> <name>mapreduce.framework.name</name> <value>yarn</value> </property> </configuration>
yarn-site.xml
<configuration> <property> <name>yarn.nodemanager.aux-services</name> <value>mapreduce_shuffle</value> </property> <property> <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name> <value>org.apache.hadoop.mapred.ShuffleHandler</value> </property> </configuration>
恳请帮忙排查可能存在的错误并提供解决建议。
内容的提问来源于stack exchange,提问作者ryan
相关产品推荐
相关产品推荐

