복붙노트

[HADOOP] ACCEPTED : 할당 시작과 RM에 등록 할 수 AM 컨테이너 기다리고.

HADOOP

ACCEPTED : 할당 시작과 RM에 등록 할 수 AM 컨테이너 기다리고.

나는 4GB의 램과 40기가바이트 HDD와 hadoop2.7.0 단일 노드 클러스터에서 일하고 있습니다. 단어 감소지도에 예를 계산 실행,이 작업을 실행 후 중지하는 동안 ... 나는 실 현장에서 컨테이너의 메모리하지만 여전히 행운을 증가 시도했습니다.

오류

16/11/20 17:05:03 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
16/11/20 17:05:07 INFO input.FileInputFormat: Total input paths to process : 1
16/11/20 17:05:08 INFO mapreduce.JobSubmitter: number of splits:1
16/11/20 17:05:08 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1479631325160_0002
16/11/20 17:05:09 INFO impl.YarnClientImpl: Submitted application application_1479631325160_0002
16/11/20 17:05:09 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1479631325160_0002/
16/11/20 17:05:09 INFO mapreduce.Job: Running job: job_1479631325160_0002

이 링크를 보여줍니다

YarnApplicationState:   ACCEPTED: waiting for AM container to be allocated, launched and register with RM. 

HDFS-site.xml 파일

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
  <name>dfs.name.dir</name>
  <value>/nn1</value>
</property>
<property>
  <name>dfs.data.dir</name>
  <value>/dn1</value>
</property>
</configuration>

코어를 site.xml

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
  <name>fs.default.name</name>
  <value>hdfs://localhost:9000</value>
</property>
</configuration>

mapred-site.xml 파일

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
  <name>mapreduce.framework.name</name>
  <value>yarn</value>
</property>
<property>
  <name>mapreduce.job.reduces</name>
  <value>1</value>
</property>
<property>  
  <name>yarn.app.mapreduce.am.resource.mb</name>  
  <value>512</value>
</property>
<property> 
  <name>yarn.app.mapreduce.am.command-opts</name> 
  <value>-Xmx410m</value>
</property>
<property>
  <name>mapreduce.map.memory.mb</name>
  <value>256</value>
</property>
<property>
  <name>mapreduce.reduce.memory.mb</name>
  <value>2048</value>
</property>
<property>
  <name>mapreduce.map.java.opts</name>
  <value>-Xmx204m</value>
</property>
<property>
  <name>mapreduce.reduce.java.opts</name>
  <value>-Xmx410m</value>
</property>
</configuration>

원사를 site.xml

<?xml version="1.0"?>
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property> 
<property>
  <name>yarn.scheduler.minimum-allocation-mb</name>
  <value>256</value>
</property>
<property> 
  <name>yarn.scheduler.maximum-allocation-mb</name> 
  <value>2048</value>
</property>
<property> 
  <name>yarn.nodemanager.resource.memory-mb</name> 
  <value>2048</value>
</property>
</configuration>

어떻게이 문제를 해결하는 방법을 가르쳐주세요.

해결법

    from https://stackoverflow.com/questions/40703676/accepted-waiting-for-am-container-to-be-allocated-launched-and-register-with-r by cc-by-sa and MIT license