hive开启很多信息和MR运行错误的原因。

hive> select count(url) from track_log;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapred.reduce.tasks=<number>
2016-03-21 22:23:20,892 WARN  [main] conf.Configuration (Configuration.java:loadProperty(2360)) - file:/tmp/hadoop/hive_2016-03-21_22-23-14_888_6634347513296177843-1/-local-10002/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-03-21 22:23:20,988 WARN  [main] conf.Configuration (Configuration.java:loadProperty(2360)) - file:/tmp/hadoop/hive_2016-03-21_22-23-14_888_6634347513296177843-1/-local-10002/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-03-21 22:23:21,267 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1011)) - mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive
2016-03-21 22:23:21,268 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1011)) - mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
2016-03-21 22:23:21,268 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1011)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2016-03-21 22:23:21,269 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1011)) - mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
2016-03-21 22:23:21,272 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1011)) - mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
2016-03-21 22:23:21,273 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1011)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2016-03-21 22:23:21,275 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1011)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2016-03-21 22:23:21,926 WARN  [main] conf.HiveConf (HiveConf.java:initialize(1155)) - DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
Execution log at: /tmp/hadoop/hadoop_20160321222323_ebcc54d6-c8ba-4b9b-9709-79002fb51018.log
Job running in-process (local Hadoop)
2016-03-21 22:23:27,242 null map = 0%,  reduce = 0%
2016-03-21 22:23:29,282 null map = 100%,  reduce = 100%
Ended Job = job_local1262919648_0001
Execution completed successfully
MapredLocal task succeeded
OK
126134
Time taken: 15.171 seconds, Fetched: 1 row(s)

 

出现这个原因是Hadoop 的 CORE-site.xml 等配置错误了。恢复配置文件就行了。

 

[hadoop@master hadoop]$ rm -rf conf

[hadoop@master hadoop]$ sudo rm -rf conf

[hadoop@master hadoop]$ ls

conf.cloudera.hdfs  conf.cloudera.mapreduce

[hadoop@master hadoop]$ sudo mkdir conf

[hadoop@master hadoop]$ sudo cp conf.cloudera.hdfs/* conf/

[hadoop@master hadoop]$ sudo cp conf.cloudera.mapreduce/* conf/

 

文件恢复 OK了!

 

 

 

你可能感兴趣的:(hive开启很多信息和MR运行错误的原因。)