복붙노트

[HADOOP] 스톰 만들기 토폴로지

HADOOP

스톰 만들기 토폴로지

나는 이클립스를 사용하여 Linux에서 폭풍 스타터 예제를 실행하려합니다. 나는 다음과 같은 오류가 점점 오전 nexttuple 함수가 호출되지 않습니다.

오류:

35979 [main] INFO  o.a.s.d.supervisor - Shutting down supervisor cfba8fc6-    81e6-47cb-b8b9-ec7c700f4dfe
35981 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] WARN  o.a.s.s.o.a.z.s.NIOServerCnxn - caught end of stream exception
org.apache.storm.shade.org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client sessionid 0x1541437f2a0000a, likely client has closed socket
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) [storm-core-1.0.0.jar:1.0.0]
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) [storm-core-1.0.0.jar:1.0.0]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_67]
35985 [Thread-10] INFO  o.a.s.event - Event manager interrupted

내 토폴로지 클래스 :

package com.storm.MobileCallLogAnalyzer;

import org.apache.storm.tuple.Fields;
import org.apache.storm.tuple.Values;

//import storm configuration packages
import org.apache.storm.Config;
import org.apache.storm.LocalCluster;
import org.apache.storm.StormSubmitter;
import org.apache.storm.topology.TopologyBuilder;

//Create main class LogAnalyserStorm submit topology.
public class LogAnalyserStorm {
   public static void main(String[] args) throws Exception{
      //Create Config instance for cluster configuration
      Config config = new Config();
      config.setDebug(true);

      //Creating Topology
      TopologyBuilder builder = new TopologyBuilder();
       builder.setSpout("call-log-reader-spout", new FakeCallLogReaderSpout());

      builder.setBolt("call-log-creator-bolt", new CallLogCreatorBolt())
         .shuffleGrouping("call-log-reader-spout");

      builder.setBolt("call-log-counter-bolt", new CallLogCounterBolt())
         .fieldsGrouping("call-log-creator-bolt", new Fields("call"));

      LocalCluster cluster = new LocalCluster();
      cluster.submitTopology("LogAnalyserStorm", config, builder.createTopology());
      Thread.sleep(10000);

      //Stop the topology
      cluster.shutdown();
   }
 }

나는 가상 머신 환경 클라우 데라 (cloudera.quickstart)가 사육사의 설치로 인한 경우 너무 모르고 일하고 있어요. 어떤 생각?

해결법

  1. ==============================

    1.

    30736 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] WARN  o.a.s.s.o.a.z.s.NIOServerCnxn - caught end of stream exception
    org.apache.storm.shade.org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client sessionid 0x1541468b5e7000d, likely client has closed socket
    at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) [storm-core-1.0.0.jar:1.0.0]
    at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) [storm-core-1.0.0.jar:1.0.0]
    at java.lang.Thread.run(Thread.java:745) [?:1.7.0_67]
    30914 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1:52175 which had sessionid 0x1541468b5e7000d
    

    즉, 지역의 폭풍 인스턴스가 로컬 클러스터 모드를 사용하여 어디 갔지 포함 된 사육사 인스턴스에 연결할 수없는 것 같다.

    https://groups.google.com/forum/#!topic/storm-user/fLB9KCTeWX0 참조

    어쩌면, 이것은 당신을 도울 것입니다!

  2. from https://stackoverflow.com/questions/36620196/storm-creating-topology by cc-by-sa and MIT license