windows下安装并启动hadoop2.6.1

2017-12-11 18:52:22来源:CSDN作者:ABCDEFG0929人点击

分享

64位windows安装hadoop没必要倒腾Cygwin,直接解压官网下载hadoop安装包到本地->最小化配置4个基本文件->执行1条启动命令->完事。一个前提是你的电脑上已经安装了jdk,设置了java环境变量,本人用的是jdk1.7.0_15。下面把这几步细化贴出来,以hadoop2.6.1为例

  1、下载hadoop安装包就不细说了:https://archive.apache.org/dist/hadoop/common/,里面有所有hadoop版本,请自行下载,本人用的是hadoop-2.6.1.tar.gz;

  2、解压也不细说了:复制到D盘根目录直接解压,出来一个目录D:/hadoop-2.6.1,(如果windows解压有问题,可以去linux环境解压,再下载至windows环境),配置到环境变量HADOOP_HOME中,在PATH里加上%HADOOP_HOME%/bin;点击http://download.csdn.net/download/abcdefg0929/10153550下载相关工具类,直接解压后把文件丢到D:/hadoop-2.6.1/bin目录中去,将其中的hadoop.dll在c:/windows/System32下也放一份;

  3、去D:/hadoop-2.6.1/etc/hadoop找到下面4个文件并按如下最小配置粘贴上去:
  
core-site.xml

  <configuration>        <property>            <name>fs.defaultFS</name>            <value>hdfs://localhost:9000</value>        </property>        </configuration>

hdfs-site.xml

<configuration>    <property>        <name>dfs.replication</name>        <value>1</value>    </property>    <property>            <name>dfs.namenode.name.dir</name>            <value>file:/hadoop/data/dfs/namenode</value>        </property>        <property>            <name>dfs.datanode.data.dir</name>            <value>file:/hadoop/data/dfs/datanode</value>      </property></configuration>

mapred-site.xml

<configuration>    <property>        <name>mapreduce.framework.name</name>        <value>yarn</value>    </property></configuration>

yarn-site.xml

<configuration>    <property>        <name>yarn.nodemanager.aux-services</name>        <value>mapreduce_shuffle</value>    </property>    <property>        <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>        <value>org.apache.hadoop.mapred.ShuffleHandler</value>    </property></configuration>

4、启动windows命令行窗口,进入hadoop-2.6.1/bin目录,执行下面2条命令,先格式化namenode再启动hadoop

D:/hadoop-2.6.1/bin>hadoop namenode -formatDEPRECATED: Use of this script to execute hdfs command is deprecated.Instead use the hdfs command for it.17/05/13 07:16:40 INFO namenode.NameNode: STARTUP_MSG:/************************************************************STARTUP_MSG: Starting NameNodeSTARTUP_MSG:   host = *****/192.168.8.5STARTUP_MSG:   args = [-format]STARTUP_MSG:   version = 2.6.1STARTUP_MSG:   classpath = D:/hadoop-2.6.1/etc/hadoop;D:/hadoop-2.6.1/share/hadoop/common/lib/activation-1.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/api-util-1.0.0-M20.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/avro-1.7.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-beanutils-1.7.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-collections-3.2.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-configuration-1.6.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-digester-1.8.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-httpclient-3.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-math3-3.1.1.jar;D:/hadoop-2.7.2/share/hadoop/common/lib/commons-net-3.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-client-2.7.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-framework-2.7.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-recipes-2.7.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/gson-2.2.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hadoop-annotations-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hadoop-auth-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hamcrest-core-1.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/httpclient-4.2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/httpcore-4.2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.7.2/share/hadoop/common/lib/jackson-xc-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/java-xmlbuilder-0.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jaxb-api-2.2.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-json-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jets3t-0.9.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jettison-1.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jsch-0.1.42.jar;D:/hadoop-2.7.2/share/hadoop/common/lib/jsp-api-2.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jsr305-3.0.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/junit-4.11.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/mockito-all-1.8.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/paranamer-2.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/slf4j-api-1.7.10.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/snappy-java-1.0.4.1.jar;D:/hadoop-2.7.2/share/hadoop/common/lib/stax-api-1.0-2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/xmlenc-0.52.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/zookeeper-3.4.6.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-common-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-nfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jsr305-3.0.0.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/log4j-1.2.17.jar;D:/hadoop-2.7.2/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xmlenc-0.52.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-nfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/activation-1.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/aopalliance-1.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-collections-3.2.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guice-3.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guice-servlet-3.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/javax.inject-1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-client-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-guice-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-json-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-server-1.9.jar;D:/hadoop-2.7.2/share/hadoop/yarn/lib/jettison-1.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jsr305-3.0.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/stax-api-1.0-2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/zookeeper-3.4.6.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-api-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-client-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-registry-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/aopalliance-1.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/avro-1.7.4.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/guice-3.0.jar;D:/hadoop-2.7.2/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/hadoop-annotations-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/javax.inject-1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/junit-4.11.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/paranamer-2.3.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.1.jarSTARTUP_MSG:   build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r b165c4fe8a74265c792ce23f546c64604acf0e41; compiled by 'jenkins' on 2016-01-26T00:08ZSTARTUP_MSG:   java = 1.8.0_101************************************************************/17/05/13 07:16:40 INFO namenode.NameNode: createNameNode [-format]Formatting using clusterid: CID-1284c5d0-592a-4a41-b185-e53fb57dcfbf17/05/13 07:16:42 INFO namenode.FSNamesystem: No KeyProvider found.17/05/13 07:16:42 INFO namenode.FSNamesystem: fsLock is fair:true17/05/13 07:16:42 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit=100017/05/13 07:16:42 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true17/05/13 07:16:42 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.00017/05/13 07:16:42 INFO blockmanagement.BlockManager: The block deletion will start around 2017 五月 13 07:16:4217/05/13 07:16:42 INFO util.GSet: Computing capacity for map BlocksMap17/05/13 07:16:42 INFO util.GSet: VM type       = 64-bit17/05/13 07:16:42 INFO util.GSet: 2.0% max memory 889 MB = 17.8 MB17/05/13 07:16:42 INFO util.GSet: capacity      = 2^21 = 2097152 entries17/05/13 07:16:42 INFO blockmanagement.BlockManager: dfs.block.access.token.enable=false17/05/13 07:16:42 INFO blockmanagement.BlockManager: defaultReplication= 117/05/13 07:16:42 INFO blockmanagement.BlockManager: maxReplication= 51217/05/13 07:16:42 INFO blockmanagement.BlockManager: minReplication= 117/05/13 07:16:42 INFO blockmanagement.BlockManager: maxReplicationStreams= 217/05/13 07:16:42 INFO blockmanagement.BlockManager: replicationRecheckInterval= 300017/05/13 07:16:42 INFO blockmanagement.BlockManager: encryptDataTransfer= false17/05/13 07:16:42 INFO blockmanagement.BlockManager: maxNumBlocksToLog= 100017/05/13 07:16:42 INFO namenode.FSNamesystem: fsOwner             = Administrator (auth:SIMPLE)17/05/13 07:16:42 INFO namenode.FSNamesystem: supergroup          = supergroup17/05/13 07:16:42 INFO namenode.FSNamesystem: isPermissionEnabled = true17/05/13 07:16:42 INFO namenode.FSNamesystem: HA Enabled: false17/05/13 07:16:42 INFO namenode.FSNamesystem: Append Enabled: true17/05/13 07:16:43 INFO util.GSet: Computing capacity for map INodeMap17/05/13 07:16:43 INFO util.GSet: VM type       = 64-bit17/05/13 07:16:43 INFO util.GSet: 1.0% max memory 889 MB = 8.9 MB17/05/13 07:16:43 INFO util.GSet: capacity      = 2^20 = 1048576 entries17/05/13 07:16:43 INFO namenode.FSDirectory: ACLs enabled? false17/05/13 07:16:43 INFO namenode.FSDirectory: XAttrs enabled? true17/05/13 07:16:43 INFO namenode.FSDirectory: Maximum size of an xattr: 1638417/05/13 07:16:43 INFO namenode.NameNode: Caching file names occuring more thantimes17/05/13 07:16:43 INFO util.GSet: Computing capacity for map cachedBlocks17/05/13 07:16:43 INFO util.GSet: VM type       = 64-bit17/05/13 07:16:43 INFO util.GSet: 0.25% max memory 889 MB = 2.2 MB17/05/13 07:16:43 INFO util.GSet: capacity      = 2^18 = 262144 entries17/05/13 07:16:43 INFO namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.999000012874603317/05/13 07:16:43 INFO namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 017/05/13 07:16:43 INFO namenode.FSNamesystem: dfs.namenode.safemode.extension  = 3000017/05/13 07:16:43 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 1017/05/13 07:16:43 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 1017/05/13 07:16:43 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,2517/05/13 07:16:43 INFO namenode.FSNamesystem: Retry cache on namenode is enabled17/05/13 07:16:43 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis17/05/13 07:16:43 INFO util.GSet: Computing capacity for map NameNodeRetryCache17/05/13 07:16:43 INFO util.GSet: VM type       = 64-bit17/05/13 07:16:43 INFO util.GSet: 0.029999999329447746% max memory 889 MB = 273.KB17/05/13 07:16:43 INFO util.GSet: capacity      = 2^15 = 32768 entries17/05/13 07:16:43 INFO namenode.FSImage: Allocated new BlockPoolId: BP-664414510-192.168.8.5-149463100321217/05/13 07:16:43 INFO common.Storage: Storage directory /hadoop/data/dfs/namenode has been successfully formatted.17/05/13 07:16:43 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 017/05/13 07:16:43 INFO util.ExitUtil: Exiting with status 017/05/13 07:16:43 INFO namenode.NameNode: SHUTDOWN_MSG:/************************************************************SHUTDOWN_MSG: Shutting down NameNode at ******/192.168.8.5************************************************************/D:/hadoop-2.6.1/bin>cd ../sbinD:/hadoop-2.6.1/sbin>start-all.cmdThis script is Deprecated. Instead use start-dfs.cmd and start-yarn.cmdstarting yarn daemonsD:/hadoop-2.6.1/sbin>jpsDataNodeNodeManagerJpsNameNodeResourceManagerD:/hadoop-2.6.1/sbin>

通过jps命令可以看到4个进程都拉起来了,到这里hadoop的安装启动已经完事了。接着我们可以用浏览器到localhost:8088看mapreduce任务,到localhost:50070->Utilites->Browse the file system看hdfs文件。如果重启hadoop无需再格式化namenode,只要stop-all.cmd再start-all.cmd就可以了。

上面拉起4个进程时会弹出4个窗口,我们可以看看这4个进程启动时都干了啥:
DataNode

DEPRECATED: Use of this script to execute hdfs command is deprecated.Instead use the hdfs command for it.17/12/11 10:31:24 INFO datanode.DataNode: STARTUP_MSG:/************************************************************STARTUP_MSG: Starting DataNodeSTARTUP_MSG:   host = n-*********/169.254.194.63STARTUP_MSG:   args = []STARTUP_MSG:   version = 2.6.1STARTUP_MSG:   classpath = D:/hadoop-2.6.1/etc/hadoop;D:/hadoop-2.6.1/share/hadoop/common/lib/activation-1.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/api-util-1.0.0-M20.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/avro-1.7.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-beanutils-1.7.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-collections-3.2.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-configuration-1.6.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-digester-1.8.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-el-1.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-httpclient-3.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-math3-3.1.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-net-3.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-client-2.6.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-framework-2.6.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-recipes-2.6.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/gson-2.2.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hadoop-annotations-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hadoop-auth-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hamcrest-core-1.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/htrace-core-3.0.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/httpclient-4.2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/httpcore-4.2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-xc-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jasper-compiler-5.5.23.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jasper-runtime-5.5.23.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/java-xmlbuilder-0.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jaxb-api-2.2.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-json-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jets3t-0.9.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jettison-1.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jsch-0.1.42.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jsp-api-2.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jsr305-1.3.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/junit-4.11.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/mockito-all-1.8.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/paranamer-2.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/slf4j-api-1.7.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/snappy-java-1.0.4.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/stax-api-1.0-2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/xmlenc-0.52.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/zookeeper-3.4.6.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-common-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-nfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-el-1.0.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/htrace-core-3.0.4.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jsp-api-2.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jsr305-1.3.9.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xmlenc-0.52.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-nfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/activation-1.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/aopalliance-1.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-collections-3.2.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-httpclient-3.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guice-3.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guice-servlet-3.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/javax.inject-1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-client-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-guice-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-json-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jettison-1.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jline-0.9.94.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jsr305-1.3.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/stax-api-1.0-2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/zookeeper-3.4.6.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-api-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-client-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-registry-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/aopalliance-1.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/avro-1.7.4.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/guice-3.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/hadoop-annotations-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/javax.inject-1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/junit-4.11.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/paranamer-2.3.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.1.jarSTARTUP_MSG:   build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r b4d876d837b830405ccdb6af94742f99d49f9c04; compiled by 'jenkins' on 2015-09-16T21:07ZSTARTUP_MSG:   java = 1.7.0_15************************************************************/

NameNode

DEPRECATED: Use of this script to execute hdfs command is deprecated.Instead use the hdfs command for it.17/12/11 10:31:24 INFO namenode.NameNode: STARTUP_MSG:/************************************************************STARTUP_MSG: Starting NameNodeSTARTUP_MSG:   host = n-*********/169.254.194.63STARTUP_MSG:   args = []STARTUP_MSG:   version = 2.6.1STARTUP_MSG:   classpath = D:/hadoop-2.6.1/etc/hadoop;D:/hadoop-2.6.1/share/hadoop/common/lib/activation-1.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/api-util-1.0.0-M20.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/avro-1.7.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-beanutils-1.7.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-collections-3.2.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-configuration-1.6.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-digester-1.8.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-el-1.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-httpclient-3.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-math3-3.1.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-net-3.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-client-2.6.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-framework-2.6.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-recipes-2.6.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/gson-2.2.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hadoop-annotations-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hadoop-auth-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hamcrest-core-1.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/htrace-core-3.0.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/httpclient-4.2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/httpcore-4.2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-xc-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jasper-compiler-5.5.23.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jasper-runtime-5.5.23.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/java-xmlbuilder-0.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jaxb-api-2.2.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-json-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jets3t-0.9.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jettison-1.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jsch-0.1.42.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jsp-api-2.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jsr305-1.3.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/junit-4.11.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/mockito-all-1.8.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/paranamer-2.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/slf4j-api-1.7.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/snappy-java-1.0.4.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/stax-api-1.0-2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/xmlenc-0.52.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/zookeeper-3.4.6.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-common-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-nfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-el-1.0.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/htrace-core-3.0.4.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jsp-api-2.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jsr305-1.3.9.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xmlenc-0.52.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-nfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/activation-1.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/aopalliance-1.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-collections-3.2.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-httpclient-3.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guice-3.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guice-servlet-3.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/javax.inject-1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-client-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-guice-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-json-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jettison-1.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jline-0.9.94.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jsr305-1.3.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/stax-api-1.0-2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/zookeeper-3.4.6.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-api-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-client-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-registry-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/aopalliance-1.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/avro-1.7.4.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/guice-3.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/hadoop-annotations-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/javax.inject-1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/junit-4.11.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/paranamer-2.3.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.1.jarSTARTUP_MSG:   build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r b4d876d837b830405ccdb6af94742f99d49f9c04; compiled by 'jenkins' on 2015-09-16T21:07ZSTARTUP_MSG:   java = 1.7.0_15************************************************************/17/12/11 10:31:24 INFO namenode.NameNode: createNameNode []17/12/11 10:31:24 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties17/12/11 10:31:24 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).17/12/11 10:31:24 INFO impl.MetricsSystemImpl: NameNode metrics system started17/12/11 10:31:24 INFO namenode.NameNode: fs.defaultFS is hdfs://localhost:900017/12/11 10:31:24 INFO namenode.NameNode: Clients are to use localhost:9000 to access this namenode/service.17/12/11 10:31:34 INFO hdfs.DFSUtil: Starting Web-server for hdfs at: http://0.0.0.0:5007017/12/11 10:31:34 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog17/12/11 10:31:34 INFO http.HttpRequestLog: Http request log for http.requests.namenode is not defined17/12/11 10:31:34 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)17/12/11 10:31:34 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs17/12/11 10:31:34 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs17/12/11 10:31:34 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static17/12/11 10:31:34 INFO http.HttpServer2: Added filter 'org.apache.hadoop.hdfs.web.AuthFilter' (class=org.apache.hadoop.hdfs.web.AuthFilter)17/12/11 10:31:34 INFO http.HttpServer2: addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*17/12/11 10:31:34 INFO http.HttpServer2: Jetty bound to port 5007017/12/11 10:31:34 INFO mortbay.log: jetty-6.1.2617/12/11 10:31:34 INFO mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:5007017/12/11 10:31:34 WARN namenode.FSNamesystem: Only one image storage directory (dfs.namenode.name.dir) configured. Beware of data loss due to lack of redundant storage directories!17/12/11 10:31:34 WARN namenode.FSNamesystem: Only one namespace edits storage directory (dfs.namenode.edits.dir) configured. Beware of data loss due to lack of redundant storage directories!17/12/11 10:31:34 INFO namenode.FSNamesystem: No KeyProvider found.17/12/11 10:31:34 INFO namenode.FSNamesystem: fsLock is fair:true17/12/11 10:31:34 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit=100017/12/11 10:31:34 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true17/12/11 10:31:34 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.00017/12/11 10:31:34 INFO blockmanagement.BlockManager: The block deletion will start around 2017 十二月 11 10:31:3417/12/11 10:31:34 INFO util.GSet: Computing capacity for map BlocksMap17/12/11 10:31:34 INFO util.GSet: VM type       = 64-bit17/12/11 10:31:34 INFO util.GSet: 2.0% max memory 888.9 MB = 17.8 MB17/12/11 10:31:34 INFO util.GSet: capacity      = 2^21 = 2097152 entries17/12/11 10:31:34 INFO blockmanagement.BlockManager: dfs.block.access.token.enable=false17/12/11 10:31:34 INFO blockmanagement.BlockManager: defaultReplication         = 117/12/11 10:31:34 INFO blockmanagement.BlockManager: maxReplication             = 51217/12/11 10:31:34 INFO blockmanagement.BlockManager: minReplication             = 117/12/11 10:31:34 INFO blockmanagement.BlockManager: maxReplicationStreams      = 217/12/11 10:31:34 INFO blockmanagement.BlockManager: shouldCheckForEnoughRacks  = false17/12/11 10:31:34 INFO blockmanagement.BlockManager: replicationRecheckInterval = 300017/12/11 10:31:34 INFO blockmanagement.BlockManager: encryptDataTransfer        = false17/12/11 10:31:34 INFO blockmanagement.BlockManager: maxNumBlocksToLog          = 100017/12/11 10:31:34 INFO namenode.FSNamesystem: fsOwner             = ********* (auth:SIMPLE)17/12/11 10:31:34 INFO namenode.FSNamesystem: supergroup          = supergroup17/12/11 10:31:34 INFO namenode.FSNamesystem: isPermissionEnabled = true17/12/11 10:31:34 INFO namenode.FSNamesystem: HA Enabled: false17/12/11 10:31:34 INFO namenode.FSNamesystem: Append Enabled: true17/12/11 10:31:35 INFO util.GSet: Computing capacity for map INodeMap17/12/11 10:31:35 INFO util.GSet: VM type       = 64-bit17/12/11 10:31:35 INFO util.GSet: 1.0% max memory 888.9 MB = 8.9 MB17/12/11 10:31:35 INFO util.GSet: capacity      = 2^20 = 1048576 entries17/12/11 10:31:35 INFO namenode.NameNode: Caching file names occuring more than 10 times17/12/11 10:31:35 INFO util.GSet: Computing capacity for map cachedBlocks17/12/11 10:31:35 INFO util.GSet: VM type       = 64-bit17/12/11 10:31:35 INFO util.GSet: 0.25% max memory 888.9 MB = 2.2 MB17/12/11 10:31:35 INFO util.GSet: capacity      = 2^18 = 262144 entries17/12/11 10:31:35 INFO namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.999000012874603317/12/11 10:31:35 INFO namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 017/12/11 10:31:35 INFO namenode.FSNamesystem: dfs.namenode.safemode.extension     = 3000017/12/11 10:31:35 INFO namenode.FSNamesystem: Retry cache on namenode is enabled17/12/11 10:31:35 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis17/12/11 10:31:35 INFO util.GSet: Computing capacity for map NameNodeRetryCache17/12/11 10:31:35 INFO util.GSet: VM type       = 64-bit17/12/11 10:31:35 INFO util.GSet: 0.029999999329447746% max memory 888.9 MB = 273.1 KB17/12/11 10:31:35 INFO util.GSet: capacity      = 2^15 = 32768 entries17/12/11 10:31:35 INFO namenode.NNConf: ACLs enabled? false17/12/11 10:31:35 INFO namenode.NNConf: XAttrs enabled? true17/12/11 10:31:35 INFO namenode.NNConf: Maximum size of an xattr: 1638417/12/11 10:31:35 INFO common.Storage: Lock on /hadoop/data/dfs/namenode/in_use.lock acquired by nodename 14240@n-*********17/12/11 10:31:35 INFO namenode.FileJournalManager: Recovering unfinalized segments in /hadoop/data/dfs/namenode/current17/12/11 10:31:35 INFO namenode.FileJournalManager: Finalizing edits file /hadoop/data/dfs/namenode/current/edits_inprogress_0000000000000000150 -> /hadoop/data/dfs/namenode/current/edits_0000000000000000150-000000000000000021017/12/11 10:31:35 INFO namenode.FSImageFormatPBINode: Loading 8 INodes.17/12/11 10:31:35 INFO namenode.FSImageFormatProtobuf: Loaded FSImage in 0 seconds.17/12/11 10:31:35 INFO namenode.FSImage: Loaded image for txid 149 from /hadoop/data/dfs/namenode/current/fsimage_000000000000000014917/12/11 10:31:35 INFO namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@27a1882 expecting start txid #15017/12/11 10:31:35 INFO namenode.FSImage: Start loading edits file /hadoop/data/dfs/namenode/current/edits_0000000000000000150-000000000000000021017/12/11 10:31:35 INFO namenode.EditLogInputStream: Fast-forwarding stream '/hadoop/data/dfs/namenode/current/edits_0000000000000000150-0000000000000000210' to transaction ID 15017/12/11 10:31:35 INFO namenode.FSImage: Edits file /hadoop/data/dfs/namenode/current/edits_0000000000000000150-0000000000000000210 of size 1048576 edits # 61 loaded in 0 seconds17/12/11 10:31:35 INFO namenode.FSNamesystem: Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false)17/12/11 10:31:35 INFO namenode.FSEditLog: Starting log segment at 21117/12/11 10:31:35 INFO namenode.NameCache: initialized with 0 entries 0 lookups17/12/11 10:31:35 INFO namenode.FSNamesystem: Finished loading FSImage in 416 msecs17/12/11 10:31:35 INFO namenode.NameNode: RPC server is binding to localhost:900017/12/11 10:31:35 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue17/12/11 10:31:35 INFO ipc.Server: Starting Socket Reader #1 for port 900017/12/11 10:31:35 INFO namenode.FSNamesystem: Registered FSNamesystemState MBean17/12/11 10:31:35 INFO namenode.LeaseManager: Number of blocks under construction: 017/12/11 10:31:35 INFO namenode.LeaseManager: Number of blocks under construction: 017/12/11 10:31:35 INFO hdfs.StateChange: STATE* Safe mode ON.The reported blocks 0 needs additional 2 blocks to reach the threshold 0.9990 of total blocks 2.The number of live datanodes 0 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached.17/12/11 10:31:35 INFO ipc.Server: IPC Server Responder: starting17/12/11 10:31:35 INFO ipc.Server: IPC Server listener on 9000: starting17/12/11 10:31:36 INFO namenode.NameNode: NameNode RPC up at: localhost/127.0.0.1:900017/12/11 10:31:36 INFO namenode.FSNamesystem: Starting services required for active state17/12/11 10:31:36 INFO blockmanagement.CacheReplicationMonitor: Starting CacheReplicationMonitor with interval 30000 milliseconds17/12/11 10:31:36 INFO blockmanagement.CacheReplicationMonitor: Rescanning after 4782753 milliseconds17/12/11 10:31:36 INFO blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 5 millisecond(s).17/12/11 10:32:06 INFO blockmanagement.CacheReplicationMonitor: Rescanning after 30001 milliseconds17/12/11 10:32:06 INFO blockmanagement.CacheReplicationMonitor: Scanned 0 directive(s) and 0 block(s) in 0 millisecond(s).17/12/11 10:32:36 INFO blockmanagement.CacheReplicationMonitor: Rescanning after 30004 milliseconds1

NodeManager

17/12/11 10:31:24 INFO nodemanager.NodeManager: STARTUP_MSG:/************************************************************STARTUP_MSG: Starting NodeManagerSTARTUP_MSG:   host = n-*********/169.254.194.63STARTUP_MSG:   args = []STARTUP_MSG:   version = 2.6.1STARTUP_MSG:   classpath = D:/hadoop-2.6.1/etc/hadoop;D:/hadoop-2.6.1/etc/hadoop;D:/hadoop-2.6.1/etc/hadoop;D:/hadoop-2.6.1/share/hadoop/common/lib/activation-1.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/api-util-1.0.0-M20.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/avro-1.7.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-beanutils-1.7.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-collections-3.2.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-configuration-1.6.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-digester-1.8.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-el-1.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-httpclient-3.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-math3-3.1.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-net-3.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-client-2.6.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-framework-2.6.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-recipes-2.6.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/gson-2.2.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hadoop-annotations-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hadoop-auth-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hamcrest-core-1.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/htrace-core-3.0.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/httpclient-4.2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/httpcore-4.2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-xc-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jasper-compiler-5.5.23.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jasper-runtime-5.5.23.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/java-xmlbuilder-0.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jaxb-api-2.2.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-json-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jets3t-0.9.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jettison-1.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jsch-0.1.42.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jsp-api-2.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jsr305-1.3.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/junit-4.11.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/mockito-all-1.8.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/paranamer-2.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/slf4j-api-1.7.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/snappy-java-1.0.4.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/stax-api-1.0-2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/xmlenc-0.52.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/zookeeper-3.4.6.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-common-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-nfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-el-1.0.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/htrace-core-3.0.4.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jsp-api-2.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jsr305-1.3.9.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xmlenc-0.52.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-nfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/activation-1.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/aopalliance-1.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-collections-3.2.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-httpclient-3.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guice-3.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guice-servlet-3.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/javax.inject-1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-client-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-guice-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-json-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jettison-1.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jline-0.9.94.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jsr305-1.3.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/stax-api-1.0-2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/zookeeper-3.4.6.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-api-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-client-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-registry-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/aopalliance-1.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/avro-1.7.4.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/guice-3.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/hadoop-annotations-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/javax.inject-1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/junit-4.11.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/paranamer-2.3.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-api-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-client-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-registry-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/activation-1.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/aopalliance-1.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-collections-3.2.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-httpclient-3.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guice-3.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guice-servlet-3.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/javax.inject-1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-client-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-guice-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-json-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jettison-1.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jline-0.9.94.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jsr305-1.3.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/stax-api-1.0-2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/zookeeper-3.4.6.jar;D:/hadoop-2.6.1/etc/hadoop/nm-config/log4j.propertiesSTARTUP_MSG:   build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r b4d876d837b830405ccdb6af94742f99d49f9c04; compiled by 'jenkins' on 2015-09-16T21:07ZSTARTUP_MSG:   java = 1.7.0_15************************************************************/17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.NodeManager17/12/11 10:31:34 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties17/12/11 10:31:34 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).17/12/11 10:31:34 INFO impl.MetricsSystemImpl: NodeManager metrics system started17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler17/12/11 10:31:34 INFO localizer.ResourceLocalizationService: per directory file limit = 819217/12/11 10:31:35 INFO localizer.ResourceLocalizationService: usercache path : file:/tmp/hadoop-*********/nm-local-dir/usercache_DEL_151295949469217/12/11 10:31:35 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker17/12/11 10:31:35 WARN containermanager.AuxServices: The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.17/12/11 10:31:35 INFO containermanager.AuxServices: Adding auxiliary service httpshuffle, "mapreduce_shuffle"17/12/11 10:31:35 INFO monitor.ContainersMonitorImpl:  Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.WindowsResourceCalculatorPlugin@52c9a2e517/12/11 10:31:35 INFO monitor.ContainersMonitorImpl:  Using ResourceCalculatorProcessTree : null17/12/11 10:31:35 INFO monitor.ContainersMonitorImpl: Physical memory check enabled: true17/12/11 10:31:35 INFO monitor.ContainersMonitorImpl: Virtual memory check enabled: true17/12/11 10:31:35 WARN monitor.ContainersMonitorImpl: NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (7.9 G). Thrashing might happen.17/12/11 10:31:35 INFO nodemanager.NodeStatusUpdaterImpl: Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=817/12/11 10:31:44 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue17/12/11 10:31:44 INFO ipc.Server: Starting Socket Reader #1 for port 149917/12/11 10:31:45 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server17/12/11 10:31:45 INFO containermanager.ContainerManagerImpl: Blocking new container-requests as container manager rpc server is still starting.17/12/11 10:31:45 INFO ipc.Server: IPC Server Responder: starting17/12/11 10:31:45 INFO ipc.Server: IPC Server listener on 1499: starting17/12/11 10:31:54 INFO security.NMContainerTokenSecretManager: Updating node address : n-*********.cattsoft.com:149917/12/11 10:31:54 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue17/12/11 10:31:54 INFO ipc.Server: Starting Socket Reader #1 for port 804017/12/11 10:31:54 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server17/12/11 10:31:54 INFO ipc.Server: IPC Server Responder: starting17/12/11 10:31:54 INFO ipc.Server: IPC Server listener on 8040: starting17/12/11 10:31:54 INFO localizer.ResourceLocalizationService: Localizer started on port 804017/12/11 10:31:54 INFO mapred.IndexCache: IndexCache created with max memory = 1048576017/12/11 10:31:54 INFO mapred.ShuffleHandler: httpshuffle listening on port 1356217/12/11 10:31:54 INFO util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux.17/12/11 10:31:54 INFO containermanager.ContainerManagerImpl: ContainerManager started at n-*********/169.254.194.63:149917/12/11 10:31:54 INFO containermanager.ContainerManagerImpl: ContainerManager bound to 0.0.0.0/0.0.0.0:017/12/11 10:31:54 INFO webapp.WebServer: Instantiating NMWebApp at 0.0.0.0:804217/12/11 10:31:54 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog17/12/11 10:31:54 INFO http.HttpRequestLog: Http request log for http.requests.nodemanager is not defined17/12/11 10:31:54 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)17/12/11 10:31:54 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node17/12/11 10:31:54 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static17/12/11 10:31:54 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs17/12/11 10:31:54 INFO http.HttpServer2: adding path spec: /node/*17/12/11 10:31:54 INFO http.HttpServer2: adding path spec: /ws/*17/12/11 10:31:54 INFO http.HttpServer2: Jetty bound to port 804217/12/11 10:31:54 INFO mortbay.log: jetty-6.1.2617/12/11 10:31:54 INFO mortbay.log: Extract jar:file:/D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-common-2.6.1.jar!/webapps/node to C:/Users/ZHANGY~1/AppData/Local/Temp/Jetty_0_0_0_0_8042_node____19tj0x/webapp17/12/11 10:31:54 INFO mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:804217/12/11 10:31:54 INFO webapp.WebApps: Web app /node started at 804217/12/11 10:31:54 INFO webapp.WebApps: Registered webapp guice modules17/12/11 10:31:55 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:803117/12/11 10:31:55 INFO nodemanager.NodeStatusUpdaterImpl: Sending out 0 NM container statuses: []17/12/11 10:31:55 INFO nodemanager.NodeStatusUpdaterImpl: Registering with RM using containers :[]17/12/11 10:31:55 INFO security.NMContainerTokenSecretManager: Rolling master-key for container-tokens, got key with id 49774521617/12/11 10:31:55 INFO security.NMTokenSecretManagerInNM: Rolling master-key for container-tokens, got key with id 183090177717/12/11 10:31:55 INFO nodemanager.NodeStatusUpdaterImpl: Registered with ResourceManager as n-*********.cattsoft.com:1499 with total resource of <memory:8192, vCores:8>17/12/11 10:31:55 INFO nodemanager.NodeStatusUpdaterImpl: Notifying ContainerManager to unblock new container-requests

ResourceManager

17/12/11 10:31:24 INFO resourcemanager.ResourceManager: STARTUP_MSG:/************************************************************STARTUP_MSG: Starting ResourceManagerSTARTUP_MSG:   host = n-*********/169.254.194.63STARTUP_MSG:   args = []STARTUP_MSG:   version = 2.6.1STARTUP_MSG:   classpath = D:/hadoop-2.6.1/etc/hadoop;D:/hadoop-2.6.1/etc/hadoop;D:/hadoop-2.6.1/etc/hadoop;D:/hadoop-2.6.1/share/hadoop/common/lib/activation-1.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/api-util-1.0.0-M20.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/avro-1.7.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-beanutils-1.7.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-collections-3.2.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-configuration-1.6.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-digester-1.8.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-el-1.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-httpclient-3.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-math3-3.1.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/commons-net-3.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-client-2.6.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-framework-2.6.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/curator-recipes-2.6.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/gson-2.2.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hadoop-annotations-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hadoop-auth-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/hamcrest-core-1.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/htrace-core-3.0.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/httpclient-4.2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/httpcore-4.2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jackson-xc-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jasper-compiler-5.5.23.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jasper-runtime-5.5.23.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/java-xmlbuilder-0.4.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jaxb-api-2.2.2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-json-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jets3t-0.9.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jettison-1.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jsch-0.1.42.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jsp-api-2.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/jsr305-1.3.9.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/junit-4.11.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/mockito-all-1.8.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/paranamer-2.3.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/slf4j-api-1.7.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/snappy-java-1.0.4.1.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/stax-api-1.0-2.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/xmlenc-0.52.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/common/lib/zookeeper-3.4.6.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-common-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/common/hadoop-nfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-el-1.0.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/htrace-core-3.0.4.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jsp-api-2.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/jsr305-1.3.9.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/lib/xmlenc-0.52.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/hdfs/hadoop-hdfs-nfs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/activation-1.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/aopalliance-1.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-collections-3.2.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-httpclient-3.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guice-3.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guice-servlet-3.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/javax.inject-1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-client-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-guice-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-json-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jettison-1.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jline-0.9.94.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jsr305-1.3.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/stax-api-1.0-2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/zookeeper-3.4.6.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-api-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-client-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-registry-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/aopalliance-1.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/avro-1.7.4.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/guice-3.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/hadoop-annotations-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/javax.inject-1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/junit-4.11.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/paranamer-2.3.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.1-tests.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-api-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-client-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-registry-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-common-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-tests-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.6.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/activation-1.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/aopalliance-1.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/asm-3.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-cli-1.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-codec-1.4.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-collections-3.2.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-compress-1.4.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-httpclient-3.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-io-2.4.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-lang-2.6.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/commons-logging-1.1.3.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guava-11.0.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guice-3.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/guice-servlet-3.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/javax.inject-1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-client-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-core-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-guice-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-json-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jersey-server-1.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jettison-1.1.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jetty-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jetty-util-6.1.26.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jline-0.9.94.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/jsr305-1.3.9.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/log4j-1.2.17.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/netty-3.6.2.Final.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/servlet-api-2.5.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/stax-api-1.0-2.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/xz-1.0.jar;D:/hadoop-2.6.1/share/hadoop/yarn/lib/zookeeper-3.4.6.jar;D:/hadoop-2.6.1/etc/hadoop/rm-config/log4j.propertiesSTARTUP_MSG:   build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r b4d876d837b830405ccdb6af94742f99d49f9c04; compiled by 'jenkins' on 2015-09-16T21:07ZSTARTUP_MSG:   java = 1.7.0_15************************************************************/17/12/11 10:31:24 INFO conf.Configuration: found resource core-site.xml at file:/D:/hadoop-2.6.1/etc/hadoop/core-site.xml17/12/11 10:31:24 INFO security.Groups: clearing userToGroupsMap cache17/12/11 10:31:24 INFO conf.Configuration: found resource yarn-site.xml at file:/D:/hadoop-2.6.1/etc/hadoop/yarn-site.xml17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher17/12/11 10:31:34 INFO security.NMTokenSecretManagerInRM: NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms17/12/11 10:31:34 INFO security.RMContainerTokenSecretManager: ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms17/12/11 10:31:34 INFO security.AMRMTokenSecretManager: AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000 ms17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager17/12/11 10:31:34 INFO resourcemanager.ResourceManager: Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher17/12/11 10:31:34 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties17/12/11 10:31:34 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).17/12/11 10:31:34 INFO impl.MetricsSystemImpl: ResourceManager metrics system started17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager17/12/11 10:31:34 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher17/12/11 10:31:34 INFO resourcemanager.RMNMInfo: Registered RMNMInfo MBean17/12/11 10:31:34 INFO util.HostsFileReader: Refreshing hosts (include/exclude) list17/12/11 10:31:34 INFO conf.Configuration: found resource capacity-scheduler.xml at file:/D:/hadoop-2.6.1/etc/hadoop/capacity-scheduler.xml17/12/11 10:31:34 INFO capacity.ParentQueue: root, capacity=1.0, asboluteCapacity=1.0, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=ADMINISTER_QUEUE:*SUBMIT_APPLICATIONS:*, labels=*,, reservationsContinueLooking=true17/12/11 10:31:34 INFO capacity.ParentQueue: Initialized parent-queue root name=root, fullname=root17/12/11 10:31:34 INFO capacity.LeafQueue: Initializing defaultcapacity = 1.0 [= (float) configuredCapacity / 100 ]asboluteCapacity = 1.0 [= parentAbsoluteCapacity * capacity ]maxCapacity = 1.0 [= configuredMaxCapacity ]absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ]userLimit = 100 [= configuredUserLimit ]userLimitFactor = 1.0 [= configuredUserLimitFactor ]maxApplications = 10000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)]maxApplicationsPerUser = 10000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ]usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)]absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory]maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ]minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ]numContainers = 0 [= currentNumContainers ]state = RUNNING [= configuredState ]acls = ADMINISTER_QUEUE:*SUBMIT_APPLICATIONS:* [= configuredAcls ]nodeLocalityDelay = 40labels=*,nodeLocalityDelay = 40reservationsContinueLooking = true17/12/11 10:31:34 INFO capacity.CapacityScheduler: Initialized queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=017/12/11 10:31:34 INFO capacity.CapacityScheduler: Initialized queue: root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=017/12/11 10:31:34 INFO capacity.CapacityScheduler: Initialized root queue root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=017/12/11 10:31:34 INFO capacity.CapacityScheduler: Initialized queue mappings, override: false17/12/11 10:31:34 INFO capacity.CapacityScheduler: Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<<memory:1024, vCores:1>>, maximumAllocation=<<memory:8192, vCores:32>>, asynchronousScheduling=false, asyncScheduleInterval=5ms17/12/11 10:31:34 INFO metrics.SystemMetricsPublisher: YARN system metrics publishing service is not enabled17/12/11 10:31:34 INFO resourcemanager.ResourceManager: Transitioning to active state17/12/11 10:31:34 INFO security.RMContainerTokenSecretManager: Rolling master-key for container-tokens17/12/11 10:31:34 INFO security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens17/12/11 10:31:34 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens17/12/11 10:31:34 INFO security.RMDelegationTokenSecretManager: storing master key with keyID 117/12/11 10:31:34 INFO delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)17/12/11 10:31:34 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens17/12/11 10:31:34 INFO security.RMDelegationTokenSecretManager: storing master key with keyID 217/12/11 10:31:34 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue17/12/11 10:31:34 INFO ipc.Server: Starting Socket Reader #1 for port 803117/12/11 10:31:35 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server17/12/11 10:31:35 INFO ipc.Server: IPC Server Responder: starting17/12/11 10:31:35 INFO ipc.Server: IPC Server listener on 8031: starting17/12/11 10:31:35 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue17/12/11 10:31:35 INFO ipc.Server: Starting Socket Reader #1 for port 803017/12/11 10:31:35 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server17/12/11 10:31:35 INFO ipc.Server: IPC Server Responder: starting17/12/11 10:31:35 INFO ipc.Server: IPC Server listener on 8030: starting17/12/11 10:31:35 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue17/12/11 10:31:35 INFO ipc.Server: Starting Socket Reader #1 for port 803217/12/11 10:31:35 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server17/12/11 10:31:35 INFO ipc.Server: IPC Server listener on 8032: starting17/12/11 10:31:35 INFO ipc.Server: IPC Server Responder: starting17/12/11 10:31:35 INFO resourcemanager.ResourceManager: Transitioned to active state17/12/11 10:31:35 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog17/12/11 10:31:35 INFO http.HttpRequestLog: Http request log for http.requests.resourcemanager is not defined17/12/11 10:31:35 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)17/12/11 10:31:44 INFO http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context cluster17/12/11 10:31:44 INFO http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context static17/12/11 10:31:44 INFO http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context logs17/12/11 10:31:44 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster17/12/11 10:31:44 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static17/12/11 10:31:44 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs17/12/11 10:31:44 INFO http.HttpServer2: adding path spec: /cluster/*17/12/11 10:31:44 INFO http.HttpServer2: adding path spec: /ws/*17/12/11 10:31:44 INFO http.HttpServer2: Jetty bound to port 808817/12/11 10:31:44 INFO mortbay.log: jetty-6.1.2617/12/11 10:31:44 INFO mortbay.log: Extract jar:file:/D:/hadoop-2.6.1/share/hadoop/yarn/hadoop-yarn-common-2.6.1.jar!/webapps/cluster to C:/Users/ZHANGY~1/AppData/Local/Temp/Jetty_0_0_0_0_8088_cluster____u0rgz3/webapp17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)17/12/11 10:31:44 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens17/12/11 10:31:45 INFO mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:808817/12/11 10:31:45 INFO webapp.WebApps: Web app /cluster started at 808817/12/11 10:31:45 INFO webapp.WebApps: Registered webapp guice modules17/12/11 10:31:45 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue17/12/11 10:31:45 INFO ipc.Server: Starting Socket Reader #1 for port 803317/12/11 10:31:45 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server17/12/11 10:31:45 INFO ipc.Server: IPC Server Responder: starting17/12/11 10:31:45 INFO ipc.Server: IPC Server listener on 8033: starting17/12/11 10:31:55 INFO util.RackResolver: Resolved n-*********.cattsoft.com to /default-rack17/12/11 10:31:55 INFO resourcemanager.ResourceTrackerService: NodeManager from node n-*********.cattsoft.com(cmPort: 1499 httpPort: 8042) registered with capability: <memory:8192, vCores:8>, assigned nodeId n-*********.cattsoft.com:149917/12/11 10:31:55 INFO rmnode.RMNodeImpl: n-*********.cattsoft.com:1499 Node Transitioned from NEW to RUNNING17/12/11 10:31:55 INFO capacity.CapacityScheduler: Added node n-*********.cattsoft.com:1499 clusterResource: <memory:8192, vCores:8>

如果hadoop datanode无法正常启动,核查配置,直接删除本地dfs,格式化hdfs即可(hadoop namenode -format)
转载自:http://www.cnblogs.com/wuxun1997/p/6847950.html

最新文章

123

最新摄影

闪念基因

微信扫一扫

第七城市微信公众平台