복붙노트

[HADOOP] 아파치 하마 설치 오류 우분투 14.04에

HADOOP

아파치 하마 설치 오류 우분투 14.04에

나는 전체 프로세스에서 포트 54310을 사용하는 hama 설치 안내서를 사용하여 hama를 설치하고 실행하려고하지만, hama에 대한 예제를 실행하려고 할 때 오류가 발생했습니다. 즉 서버 : localhost / 127.0.0.1:40000에 다시 연결하려고합니다.

여기 내 hama-site.xml이 있습니다.

<configuration>
<property>
 <name>bsp.master.address</name>
 <value>localhost</value>
 <description>The address of the bsp master server. Either the
 literal string "local" or a host[:port] (where host is a name or
 IP address) for distributed mode.
 </description>
 </property>
 <property>
 <name>bsp.system.dir</name>
 <value>/tmp/hama-hduser/bsp/system</value>
 <description>The shared directory where BSP stores control files.
 </description>
 </property>
 <property>
 <name>bsp.local.dir</name>
 <value>/tmp/hama-hduser/bsp/local</value>
 <description>local directory for temporal store.</description>
 </property>
<property>
<name>hama.tmp.dir</name>
 <value>/tmp/hama-hduser</value>
 <description>Temporary directory on the local filesystem.</description>
 </property>
 <property>
 <name>fs.default.name</name>
 <value>hdfs://localhost:54310</value>
 <description>
 The name of the default file system. Either the literal string
 "local" or a host:port for HDFS.
 </description>
 </property>
</configuration>
hduser@ubuntu:/opt/hama$ /opt/hama/bin/hama jar hama-examples-0.6.4.jar pi
14/05/28 05:50:57 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:40000. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
14/05/28 05:50:58 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:40000. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
14/05/28 05:50:59 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:40000. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
14/05/28 05:51:00 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:40000. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
14/05/28 05:51:01 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:40000. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
14/05/28 05:51:02 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:40000. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
14/05/28 05:51:03 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:40000. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
14/05/28 05:51:04 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:40000. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
14/05/28 05:51:05 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:40000. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
14/05/28 05:51:06 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:40000. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)
java.net.ConnectException: Call to localhost/127.0.0.1:40000 failed on connection exception: java.net.ConnectException: Connection refused
    at org.apache.hama.ipc.Client.wrapException(Client.java:937)
    at org.apache.hama.ipc.Client.call(Client.java:913)
    at org.apache.hama.ipc.RPC$Invoker.invoke(RPC.java:238)
    at com.sun.proxy.$Proxy1.getProtocolVersion(Unknown Source)
    at org.apache.hama.ipc.RPC.checkVersion(RPC.java:434)
    at org.apache.hama.ipc.RPC.getProxy(RPC.java:426)
    at org.apache.hama.ipc.RPC.getProxy(RPC.java:403)
    at org.apache.hama.ipc.RPC.getProxy(RPC.java:368)
    at org.apache.hama.bsp.BSPJobClient.init(BSPJobClient.java:230)
    at org.apache.hama.bsp.BSPJobClient.<init>(BSPJobClient.java:221)
    at org.apache.hama.bsp.BSPJob.<init>(BSPJob.java:57)
    at org.apache.hama.bsp.BSPJob.<init>(BSPJob.java:75)
    at org.apache.hama.examples.PiEstimator.main(PiEstimator.java:119)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:483)
    at org.apache.hama.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
    at org.apache.hama.util.ProgramDriver.driver(ProgramDriver.java:139)
    at org.apache.hama.examples.ExampleDriver.main(ExampleDriver.java:45)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:483)
    at org.apache.hama.util.RunJar.main(RunJar.java:146)
Caused by: java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
    at org.apache.hama.util.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:204)
    at org.apache.hama.util.BSPNetUtils.connect(BSPNetUtils.java:375)
    at org.apache.hama.util.BSPNetUtils.connect(BSPNetUtils.java:347)
    at org.apache.hama.ipc.Client$Connection.setupConnection(Client.java:364)
    at org.apache.hama.ipc.Client$Connection.setupIOstreams(Client.java:408)
    at org.apache.hama.ipc.Client$Connection.access$1600(Client.java:195)
    at org.apache.hama.ipc.Client.getConnection(Client.java:1049)
    at org.apache.hama.ipc.Client.call(Client.java:888)
    ... 23 more

해결법

  1. ==============================

    1.Hama는 hadoop 1.x 용으로 컴파일되었으므로 hadoop 2.x를 사용하지 마십시오.

    Hama는 hadoop 1.x 용으로 컴파일되었으므로 hadoop 2.x를 사용하지 마십시오.

  2. ==============================

    2.사실 귀하의 재산 :

    사실 귀하의 재산 :

    <property>
      <name>fs.default.name</name>
      <value>hdfs://localhost:54310</value>
      <description>
       The name of the default file system. Either the literal string
       "local" or a host:port for HDFS.
      </description>  
    </property> 
    

    HDFS에 액세스하기 위해 클라이언트 주소를 정의합니다. core-site.xml에서이 속성의 현재 값을 확인하십시오.

    나는 하마를 사용한 적이 없지만이 속성을 변경해야한다고 생각합니다.

    <property>
      <name>bsp.master.address</name>
      <value>localhost:40000</value>
      <description>The address of the bsp master server. Either the
       literal string "local" or a host[:port] (where host is a name or
       IP address) for distributed mode.
      </description>
    </property>
    

    어쩌면 방화벽의 규칙을 확인하려고하면 포트 40000을 차단하거나 이미 사용할 수 있습니다.

  3. from https://stackoverflow.com/questions/23912772/apache-hama-installation-error-on-ubuntu-14-04 by cc-by-sa and MIT license