[HADOOP] OOZIE는 : JA009 : RPC 응답은 최대 데이터 길이를 초과

OOZIE는 : JA009 : RPC 응답은 최대 데이터 길이를 초과

OOZIE 예를 단어 수 JA009하여 준다 : RPC 응답 최대 데이터 길이를 초과한다. 우리는 ipc.maximum.data.length을 두 배로 네임 노드를 다시 시작했다.

2018-12-05 17:55:45,914  WARN MapReduceActionExecutor:523 - SERVER[******] USER[******] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000004-181205174411487-oozie-******-W] ACTION[0000004-181205174411487-oozie-******-W@mr-node] No credential properties found for action : 0000004-181205174411487-oozie-******-W@mr-node, cred : null
2018-12-05 18:10:46,019  WARN ActionStartXCommand:523 - SERVER[******] USER[******] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000004-181205174411487-oozie-******-W] ACTION[0000004-181205174411487-oozie-******-W@mr-node] Error starting action [mr-node]. ErrorType [TRANSIENT], ErrorCode [JA009], Message [JA009: RPC response exceeds maximum data length]
org.apache.oozie.action.ActionExecutorException: JA009: RPC response exceeds maximum data length
    at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:463)
    at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:437)
    at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1070)
    at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1512)
    at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:243)
    at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:68)
    at org.apache.oozie.command.XCommand.call(XCommand.java:290)
    at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:334)
    at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:263)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:181)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.ipc.RpcException: RPC response exceeds maximum data length
    at org.apache.hadoop.ipc.Client$IpcStreams.readResponse(Client.java:1808)
    at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1163)
    at org.apache.hadoop.ipc.Client$Connection.run(Client.java:1059)

어떤 도움을 주시면 감사하겠습니다. 감사

해결법

1. ==============================

   1.당신은 HDFS-site.xml 파일에서 설정을 수정하려고 했습니까?

   당신은 HDFS-site.xml 파일에서 설정을 수정하려고 했습니까?

   <property>
        <name>ipc.maximum.data.length</name>
        <value>134217728</value>
   </property>
   

   그것은 이미 충분히 높은 경우, fs.default.name 핵심-site.xml의 구성이 아니라 로컬 호스트는 IP를 사용하고 있는지 확인하십시오.

   <configuration>
          ....
           <property>
                   <name>fs.default.name</name>
                   <value>hdfs://your ip:9000</value>
           </property>
   </configuration>
   

from https://stackoverflow.com/questions/53633054/oozie-ja009-rpc-response-exceeds-maximum-data-length by cc-by-sa and MIT license