欢迎来到尧图网

客户服务 关于我们

您的位置:首页 > 汽车 > 维修 > hadoop集群没有datanode异常

hadoop集群没有datanode异常

2025/2/22 2:07:39 来源:https://blog.csdn.net/qq_21732187/article/details/145657721  浏览:    关键词:hadoop集群没有datanode异常
上传文件到hdfs:
hadoop fs -put README.txt /

报错:
WARN hdfs.DFSClient: DataStreamer Exception
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /README.txt.COPYING could only be replicated to 0 nodes instead of minReplication (=1). There are 0 datanode(s) running and no node(s) are excluded in this operation.
put: File /README.txt.COPYING could only be replicated to 0 nodes instead of minReplication (=1). There are 0 datanode(s) running and no node(s) are excluded in this operation.

查看从节点的日志:
cd $HADOOP_HOME
cd logs
tail -f hadoop-root-datanode-slave1.log

报错:
FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool (Datanode Uuid unassigned) service to master/192.168.204.130:9000. Exiting.

java.io.IOException: All specified directories are failed to load.

WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service for: Block pool (Datanode Uuid unassigned) service to master

已解决[重新格式化集群]
1、关闭集群【只在master上操作】2、rm -rf /usr/local/src/hadoop-2.6.1/dfs/name/*【每个节点操作】3、rm -rf /usr/local/src/hadoop-2.6.1/dfs/data/*【每个节点操作】4、rm -rf /usr/local/src/hadoop-2.6.1/tmp/*【每个节点操作】5、rm -rf /usr/local/src/hadoop-2.6.1/logs/*【每个节点操作】6、重新格式化:hadoop namenode -format【只在master上操作】7、启动集群【只在master上操作】

版权声明:

本网仅为发布的内容提供存储空间,不对发表、转载的内容提供任何形式的保证。凡本网注明“来源:XXX网络”的作品,均转载自其它媒体,著作权归作者所有,商业转载请联系作者获得授权,非商业转载请注明出处。

我们尊重并感谢每一位作者,均已注明文章来源和作者。如因作品内容、版权或其它问题,请及时与我们联系,联系邮箱:809451989@qq.com,投稿邮箱:809451989@qq.com

热搜词