개요
하둡의 일부 데이터노드 제거 후 MR을 돌렸을 때 아래와 같은 이슈가 발생
에러로그
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /tmp/load-20170418065239006-2825_hbaseOutputPath_serviceHbase/_temporary/_attempt_201701161900_801357_r_000006_2/f/6f1823f125c849c5aa4bc094531c4e91 could only be replicated to 0 nodes instead of minReplication (=1). There are 20 datanode(s) running and no node(s) are excluded in this operation.
at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1557)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3286)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:676)
at org.apache.hadoop.hdfs.server.namenode.AuthorizationProviderProxyClientProtocol.addBlock(AuthorizationProviderProxyClientProtocol.java:212)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:483)
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolP
해결책
- http://stackoverflow.com/questions/34245682/could-only-be-replicated-to-0-nodes-instead-of-minreplication-1-there-are-4와 https://wiki.apache.org/hadoop/CouldOnlyBeReplicatedTo를 참조했지만 해결되지 않음
- 네임노드를 재시작 하여 해결