shjita头像
关注

上传hadoop一个文本文件出错的记录。


[root@master common]# hdfs dfs -put word.txt /
2026-10-04 20:13:27,535 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2026-10-04 20:13:28,917 INFO hdfs.DataStreamer: Exception in createBlockOutputStream blk_1073741825_1001
java.io.IOException: Got error, status=ERROR, status message , ack with firstBadLink as 192.168.2.106:9866
        at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:134)
        at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:110)
        at org.apache.hadoop.hdfs.DataStreamer.createBlockOutputStream(DataStreamer.java:1778)
        at org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1679)
        at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:716)
2026-10-04 20:13:28,941 WARN hdfs.DataStreamer: Abandoning BP-531821864-192.168.2.104-1791105771861:blk_1073741825_1001
2026-10-04 20:13:28,975 WARN hdfs.DataStreamer: Excluding datanode DatanodeInfoWithStorage[192.168.2.106:9866,DS-3ab23d13-0a13-43a2-9b15-a177c2f509d0,DISK]
2026-10-04 20:13:28,994 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false
2026-10-04 20:13:29,051 INFO hdfs.DataStreamer: Exception in createBlockOutputStream blk_1073741826_1002
java.io.IOException: Got error, status=ERROR, status message , ack with firstBadLink as 192.168.2.105:9866
        at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:134)
        at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:110)
        at org.apache.hadoop.hdfs.DataStreamer.createBlockOutputStream(DataStreamer.java:1778)
        at org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1679)
        at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:716)
2026-10-04 20:13:29,051 WARN hdfs.DataStreamer: Abandoning BP-531821864-192.168.2.104-1791105771861:blk_1073741826_1002
2026-10-04 20:13:29,054 WARN hdfs.DataStreamer: Excluding datanode DatanodeInfoWithStorage[192.168.2.105:9866,DS-4ee244f5-d185-4038-ae1f-04013c111be6,DISK]
2026-10-04 20:13:29,083 INFO sasl.SaslDataTransferClient: SASL encryption trust check: localHostTrusted = false, remoteHostTrusted = false

主要是几个机器之间内部通信的问题。是防火墙导致的。

将几个机器的防火墙关一下。

简单点用iptables -F清一下。

彻底关一下。

 systemctl stop firewalld
systemctl disable firewalld
 

转载自 CSDN-专业IT技术社区

原文链接:https://blog.csdn.net/shjita/article/details/167081700

文章来源转载

评论

赞0

评论列表

微信小程序
QQ小程序

关于作者

点赞数:0
关注数:0
粉丝:0
文章:0
关注标签:0
加入于:--