首页 诗词 字典 板报 句子 名言 友答 励志 学校 网站地图
当前位置: 首页 > 教程频道 > 网络技术 > 网络基础 >

大家来看看,nutch配置分布式有关问题

2012-03-22 
大家来看看,nutch配置分布式问题?我配置NUTCH分布式时con/slaves的slaves配置的是192。168。0。109//ubuntuse

大家来看看,nutch配置分布式问题?
我配置NUTCH分布式时con/slaves的slaves配置的是
192。168。0。109//ubuntuserver2
192。168。0。107//ubuntuserver
当我启动bin/start-all.sh后我查看只有一个datanode,这个datanode有时是ubuntuserver,有时是ubuntuserver2,如是我查看了哪个datanode没起来的LOGS

009-03-03 04:23:16,064 INFO http.HttpServer - Version Jetty/5.1.4
2009-03-03 04:23:16,074 INFO util.Credential - Checking Resource aliases
2009-03-03 04:23:16,664 INFO util.Container - Started org.mortbay.jetty.servlet.WebApplicationHandler@ded0f0
2009-03-03 04:23:16,715 INFO util.Container - Started WebApplicationContext[/static,/static]
2009-03-03 04:23:16,876 INFO util.Container - Started org.mortbay.jetty.servlet.WebApplicationHandler@20fa83
2009-03-03 04:23:16,877 INFO util.Container - Started WebApplicationContext[/logs,/logs]
2009-03-03 04:23:16,995 INFO util.Container - Started org.mortbay.jetty.servlet.WebApplicationHandler@190ef12
2009-03-03 04:23:17,002 INFO util.Container - Started WebApplicationContext[/,/]
2009-03-03 04:23:17,007 INFO http.SocketListener - Started SocketListener on 0.0.0.0:50075
2009-03-03 04:23:17,007 INFO util.Container - Started org.mortbay.jetty.Server@59a34
2009-03-03 04:23:32,098 WARN datanode.DataNode - DataNode is shutting down: org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hdfs.protocol.UnregisteredDatanodeException: Data node 192.168.0.107:50010 is attempting to report storage ID DS-1380782967-192.168.0.109-50010-1236094386533. Node 192.168.0.109:50010 is expected to serve this storage.
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getDatanode(FSNamesystem.java:3800)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.processReport(FSNamesystem.java:2801)
at org.apache.hadoop.hdfs.server.namenode.NameNode.blockReport(NameNode.java:636)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:481)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:894)

at org.apache.hadoop.ipc.Client.call(Client.java:697)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:216)
at $Proxy4.blockReport(Unknown Source)
at org.apache.hadoop.hdfs.server.datanode.DataNode.offerService(DataNode.java:734)
at org.apache.hadoop.hdfs.server.datanode.DataNode.run(DataNode.java:1141)
at java.lang.Thread.run(Thread.java:619)

2009-03-03 04:23:32,098 INFO util.ThreadedServer - Stopping Acceptor ServerSocket[addr=0.0.0.0/0.0.0.0,port=0,localport=50075]
2009-03-03 04:23:32,105 INFO http.SocketListener - Stopped SocketListener on 0.0.0.0:50075
2009-03-03 04:23:32,107 INFO util.Container - Stopped org.mortbay.jetty.servlet.WebApplicationHandler@ded0f0
2009-03-03 04:23:32,187 INFO util.Container - Stopped WebApplicationContext[/static,/static]
2009-03-03 04:23:32,188 INFO util.Container - Stopped org.mortbay.jetty.servlet.WebApplicationHandler@20fa83
2009-03-03 04:23:32,251 INFO util.Container - Stopped WebApplicationContext[/logs,/logs]
2009-03-03 04:23:32,251 INFO util.Container - Stopped org.mortbay.jetty.servlet.WebApplicationHandler@190ef12
2009-03-03 04:23:32,298 INFO util.Container - Stopped WebApplicationContext[/,/]
2009-03-03 04:23:32,298 INFO util.Container - Stopped org.mortbay.jetty.Server@59a34
2009-03-03 04:23:32,304 WARN datanode.DataNode - DatanodeRegistration(192.168.0.107:50010, storageID=DS-1380782967-192.168.0.109-50010-1236094386533, infoPort=50075, ipcPort=50020):DataXceiveServer: java.nio.channels.AsynchronousCloseException
at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152)
at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84)


at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:130)
at java.lang.Thread.run(Thread.java:619)



[解决办法]
nutch啊,还没有弄会,等弄明白了,再来看!

热点排行