张超

安装 Mahout

1、下载
下载地址：http://archive.apache.org/dist/mahout/ ，选择需要的版本，下载安装包
例如：wget http://archive.apache.org/dist/mahout/0.9/mahout-distribution-0.9.tar.gz

2、解压
[grid@hadoop1 ~]$ tar -zxvf mahout-distribution-0.9.tar.gz

3、新增环境变量
[grid@hadoop1 ~]$ vi .bash_profile
export HADOOP_HOME=/home/grid/hadoop-1.2.1
export HADOOP_CONF_DIR=/home/grid/hadoop-1.2.1/conf
export MAHOUT_HOME=/home/grid/mahout-distribution-0.9
export MAHOUT_CONF_DIR=/home/grid/mahout-distribution-0.9/conf
export PATH=$PATH:$MAHOUT_HOME/conf:$MAHOUT_HOME/bin

使用环境变量生效
[grid@hadoop1 ~]$ source .bash_profile

附：几个重要的环境变量
JAVA_HOME mahout运行需指定jdk的目录
MAHOUT_JAVA_HOME 指定此变量可覆盖JAVA_HOME值
HADOOP_HOME 如果配置，则在hadoop分布式平台上运行，否则单机运行
HADOOP_CONF_DIR 指定hadoop的配置文件目录
MAHOUT_LOCAL 如果此变量值不为空，则单机运行mahout
MAHOUT_CONF_DIR mahout配置文件的路径，默认值是$MAHOUT_HOME/src/conf
MAHOUT_HEAPSIZE mahout运行时可用的最大heap大小

4、将 mahout 复制到集群中的其它机器上，并设置环境变量
[grid@hadoop1 ~]$ scp -r ~/mahout-distribution-0.9 grid@hadoop2:~
[grid@hadoop1 ~]$ scp -r ~/mahout-distribution-0.9 grid@hadoop3:~

5、启动Hadoop
[grid@hadoop1 ~]$ sh ~/hadoop-1.2.1/bin/start-all.sh

6、验证 mahout 是否安装成功
[grid@hadoop2 ~]$ mahout -help

7、运行20newsgroup的测试样例

[grid@hadoop1 ~]$ sh $MAHOUT_HOME/examples/bin/classify-20newsgroups.sh
Please select a number to choose the corresponding task to run
1. cnaivebayes
2. naivebayes
3. sgd
4. clean -- cleans up the work area in /tmp/mahout-work-grid
Enter your choice : 1
ok. You chose 1 and we'll use cnaivebayes
creating work directory at /tmp/mahout-work-grid
Downloading 20news-bydate
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 13.7M  100 13.7M    0     0  86594      0  0:02:47  0:02:47 --:--:--  122k
Extracting...
+ echo 'Preparing 20newsgroups data'
Preparing 20newsgroups data
+ rm -rf /tmp/mahout-work-grid/20news-all
+ mkdir /tmp/mahout-work-grid/20news-all
+ cp -R /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/alt.atheism /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/comp.graphics /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/comp.os.ms-windows.misc /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/comp.sys.ibm.pc.hardware /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/comp.sys.mac.hardware /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/comp.windows.x /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/misc.forsale /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/rec.autos /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/rec.motorcycles /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/rec.sport.baseball /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/rec.sport.hockey /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/sci.crypt /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/sci.electronics /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/sci.med /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/sci.space /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/soc.religion.christian /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/talk.politics.guns /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/talk.politics.mideast /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/talk.politics.misc /tmp/mahout-work-grid/20news-bydate/20news-bydate-test/talk.religion.misc /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/alt.atheism /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/comp.graphics /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/comp.os.ms-windows.misc /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/comp.sys.ibm.pc.hardware /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/comp.sys.mac.hardware /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/comp.windows.x /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/misc.forsale /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/rec.autos /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/rec.motorcycles /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/rec.sport.baseball /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/rec.sport.hockey /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/sci.crypt /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/sci.electronics /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/sci.med /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/sci.space /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/soc.religion.christian /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/talk.politics.guns /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/talk.politics.mideast /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/talk.politics.misc /tmp/mahout-work-grid/20news-bydate/20news-bydate-train/talk.religion.misc /tmp/mahout-work-grid/20news-all
+ '[' /home/grid/hadoop-1.2.1 '!=' '' ']'
+ '[' '' == '' ']'
+ echo 'Copying 20newsgroups data to HDFS'
Copying 20newsgroups data to HDFS
+ set +e
+ /home/grid/hadoop-1.2.1/bin/hadoop dfs -rmr /tmp/mahout-work-grid/20news-all
Warning: $HADOOP_HOME is deprecated.

Deleted hdfs://hadoop1:9000/tmp/mahout-work-grid/20news-all
+ set -e
+ /home/grid/hadoop-1.2.1/bin/hadoop dfs -put /tmp/mahout-work-grid/20news-all /tmp/mahout-work-grid/20news-all
Warning: $HADOOP_HOME is deprecated.

+ echo 'Creating sequence files from 20newsgroups data'
Creating sequence files from 20newsgroups data
+ ./bin/mahout seqdirectory -i /tmp/mahout-work-grid/20news-all -o /tmp/mahout-work-grid/20news-seq -ow
MAHOUT_LOCAL is not set; adding HADOOP_CONF_DIR to classpath.
Warning: $HADOOP_HOME is deprecated.

Running on hadoop, using /home/grid/hadoop-1.2.1/bin/hadoop and HADOOP_CONF_DIR=/home/grid/hadoop-1.2.1/conf
MAHOUT-JOB: /home/grid/mahout-distribution-0.9/mahout-examples-0.9-job.jar
Warning: $HADOOP_HOME is deprecated.

15/03/08 20:54:40 INFO common.AbstractJob: Command line arguments: {--charset=[UTF-8], --chunkSize=[64], --endPhase=[2147483647], --fileFilterClass=[org.apache.mahout.text.PrefixAdditionFilter], --input=[/tmp/mahout-work-grid/20news-all], --keyPrefix=[], --method=[mapreduce], --output=[/tmp/mahout-work-grid/20news-seq], --overwrite=null, --startPhase=[0], --tempDir=[temp]}
15/03/08 20:54:48 INFO input.FileInputFormat: Total input paths to process : 18846
15/03/08 20:54:50 INFO util.NativeCodeLoader: Loaded the native-hadoop library
15/03/08 20:54:50 WARN snappy.LoadSnappy: Snappy native library not loaded
15/03/08 20:55:36 INFO mapred.JobClient: Running job: job_201503081659_0001
15/03/08 20:55:37 INFO mapred.JobClient:  map 0% reduce 0%
15/03/08 20:56:05 INFO mapred.JobClient:  map 1% reduce 0%
15/03/08 20:56:08 INFO mapred.JobClient:  map 2% reduce 0%
15/03/08 20:56:11 INFO mapred.JobClient:  map 4% reduce 0%
15/03/08 20:56:14 INFO mapred.JobClient:  map 6% reduce 0%
15/03/08 20:56:17 INFO mapred.JobClient:  map 7% reduce 0%
15/03/08 20:56:20 INFO mapred.JobClient:  map 8% reduce 0%
15/03/08 20:56:23 INFO mapred.JobClient:  map 10% reduce 0%
15/03/08 20:56:26 INFO mapred.JobClient:  map 11% reduce 0%
15/03/08 20:56:29 INFO mapred.JobClient:  map 13% reduce 0%
15/03/08 20:56:32 INFO mapred.JobClient:  map 17% reduce 0%
15/03/08 20:56:35 INFO mapred.JobClient:  map 18% reduce 0%
15/03/08 20:56:38 INFO mapred.JobClient:  map 19% reduce 0%
15/03/08 20:56:41 INFO mapred.JobClient:  map 20% reduce 0%
15/03/08 20:56:44 INFO mapred.JobClient:  map 22% reduce 0%
15/03/08 20:56:47 INFO mapred.JobClient:  map 23% reduce 0%
15/03/08 20:56:51 INFO mapred.JobClient:  map 26% reduce 0%
15/03/08 20:56:54 INFO mapred.JobClient:  map 28% reduce 0%
15/03/08 20:56:57 INFO mapred.JobClient:  map 29% reduce 0%
15/03/08 20:57:00 INFO mapred.JobClient:  map 31% reduce 0%
15/03/08 20:57:03 INFO mapred.JobClient:  map 32% reduce 0%
15/03/08 20:57:06 INFO mapred.JobClient:  map 33% reduce 0%
15/03/08 20:57:09 INFO mapred.JobClient:  map 35% reduce 0%
15/03/08 20:57:12 INFO mapred.JobClient:  map 37% reduce 0%
15/03/08 20:57:15 INFO mapred.JobClient:  map 38% reduce 0%
15/03/08 20:57:18 INFO mapred.JobClient:  map 40% reduce 0%
15/03/08 20:57:21 INFO mapred.JobClient:  map 41% reduce 0%
15/03/08 20:57:24 INFO mapred.JobClient:  map 43% reduce 0%
15/03/08 20:57:27 INFO mapred.JobClient:  map 45% reduce 0%
15/03/08 20:57:30 INFO mapred.JobClient:  map 47% reduce 0%
15/03/08 20:57:33 INFO mapred.JobClient:  map 50% reduce 0%
15/03/08 20:57:36 INFO mapred.JobClient:  map 52% reduce 0%
15/03/08 20:57:39 INFO mapred.JobClient:  map 54% reduce 0%
15/03/08 20:57:42 INFO mapred.JobClient:  map 56% reduce 0%
15/03/08 20:57:46 INFO mapred.JobClient:  map 57% reduce 0%
15/03/08 20:57:49 INFO mapred.JobClient:  map 59% reduce 0%
15/03/08 20:57:52 INFO mapred.JobClient:  map 62% reduce 0%
15/03/08 20:57:55 INFO mapred.JobClient:  map 65% reduce 0%
15/03/08 20:57:58 INFO mapred.JobClient:  map 67% reduce 0%
15/03/08 20:58:01 INFO mapred.JobClient:  map 69% reduce 0%
15/03/08 20:58:04 INFO mapred.JobClient:  map 72% reduce 0%
15/03/08 20:58:07 INFO mapred.JobClient:  map 75% reduce 0%
15/03/08 20:58:10 INFO mapred.JobClient:  map 78% reduce 0%
15/03/08 20:58:13 INFO mapred.JobClient:  map 80% reduce 0%
15/03/08 20:58:16 INFO mapred.JobClient:  map 84% reduce 0%
15/03/08 20:58:19 INFO mapred.JobClient:  map 87% reduce 0%
15/03/08 20:58:22 INFO mapred.JobClient:  map 91% reduce 0%
15/03/08 20:58:25 INFO mapred.JobClient:  map 94% reduce 0%
15/03/08 20:58:28 INFO mapred.JobClient:  map 97% reduce 0%
15/03/08 20:58:32 INFO mapred.JobClient:  map 100% reduce 0%
15/03/08 20:58:36 INFO mapred.JobClient: Job complete: job_201503081659_0001
15/03/08 20:58:36 INFO mapred.JobClient: Counters: 18
15/03/08 20:58:36 INFO mapred.JobClient:   Job Counters 
15/03/08 20:58:36 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=171122
15/03/08 20:58:36 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/03/08 20:58:36 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/03/08 20:58:36 INFO mapred.JobClient:     Launched map tasks=1
15/03/08 20:58:36 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0
15/03/08 20:58:36 INFO mapred.JobClient:   File Output Format Counters 
15/03/08 20:58:36 INFO mapred.JobClient:     Bytes Written=19202391
15/03/08 20:58:36 INFO mapred.JobClient:   FileSystemCounters
15/03/08 20:58:36 INFO mapred.JobClient:     HDFS_BYTES_READ=37565643
15/03/08 20:58:36 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=60041
15/03/08 20:58:36 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=19202391
15/03/08 20:58:36 INFO mapred.JobClient:   File Input Format Counters 
15/03/08 20:58:36 INFO mapred.JobClient:     Bytes Read=0
15/03/08 20:58:36 INFO mapred.JobClient:   Map-Reduce Framework
15/03/08 20:58:36 INFO mapred.JobClient:     Map input records=18846
15/03/08 20:58:36 INFO mapred.JobClient:     Physical memory (bytes) snapshot=113790976
15/03/08 20:58:36 INFO mapred.JobClient:     Spilled Records=0
15/03/08 20:58:36 INFO mapred.JobClient:     CPU time spent (ms)=109350
15/03/08 20:58:36 INFO mapred.JobClient:     Total committed heap usage (bytes)=46481408
15/03/08 20:58:36 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=724959232
15/03/08 20:58:36 INFO mapred.JobClient:     Map output records=18846
15/03/08 20:58:36 INFO mapred.JobClient:     SPLIT_RAW_BYTES=1710640
15/03/08 20:58:36 INFO driver.MahoutDriver: Program took 237312 ms (Minutes: 3.9552)
+ echo 'Converting sequence files to vectors'
Converting sequence files to vectors
+ ./bin/mahout seq2sparse -i /tmp/mahout-work-grid/20news-seq -o /tmp/mahout-work-grid/20news-vectors -lnorm -nv -wt tfidf
MAHOUT_LOCAL is not set; adding HADOOP_CONF_DIR to classpath.
Warning: $HADOOP_HOME is deprecated.

Running on hadoop, using /home/grid/hadoop-1.2.1/bin/hadoop and HADOOP_CONF_DIR=/home/grid/hadoop-1.2.1/conf
MAHOUT-JOB: /home/grid/mahout-distribution-0.9/mahout-examples-0.9-job.jar
Warning: $HADOOP_HOME is deprecated.

15/03/08 20:58:44 INFO vectorizer.SparseVectorsFromSequenceFiles: Maximum n-gram size is: 1
15/03/08 20:58:44 INFO vectorizer.SparseVectorsFromSequenceFiles: Minimum LLR value: 1.0
15/03/08 20:58:44 INFO vectorizer.SparseVectorsFromSequenceFiles: Number of reduce tasks: 1
15/03/08 20:58:44 INFO vectorizer.SparseVectorsFromSequenceFiles: Tokenizing documents in /tmp/mahout-work-grid/20news-seq
15/03/08 20:58:47 INFO input.FileInputFormat: Total input paths to process : 1
15/03/08 20:58:49 INFO mapred.JobClient: Running job: job_201503081659_0002
15/03/08 20:58:50 INFO mapred.JobClient:  map 0% reduce 0%
15/03/08 20:59:11 INFO mapred.JobClient:  map 46% reduce 0%
15/03/08 20:59:14 INFO mapred.JobClient:  map 97% reduce 0%
15/03/08 20:59:19 INFO mapred.JobClient:  map 100% reduce 0%
15/03/08 20:59:24 INFO mapred.JobClient: Job complete: job_201503081659_0002
15/03/08 20:59:24 INFO mapred.JobClient: Counters: 19
15/03/08 20:59:24 INFO mapred.JobClient:   Job Counters 
15/03/08 20:59:24 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=29191
15/03/08 20:59:24 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/03/08 20:59:24 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/03/08 20:59:24 INFO mapred.JobClient:     Launched map tasks=1
15/03/08 20:59:24 INFO mapred.JobClient:     Data-local map tasks=1
15/03/08 20:59:24 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0
15/03/08 20:59:24 INFO mapred.JobClient:   File Output Format Counters 
15/03/08 20:59:24 INFO mapred.JobClient:     Bytes Written=27503580
15/03/08 20:59:24 INFO mapred.JobClient:   FileSystemCounters
15/03/08 20:59:24 INFO mapred.JobClient:     HDFS_BYTES_READ=19202520
15/03/08 20:59:24 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=58026
15/03/08 20:59:24 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=27503580
15/03/08 20:59:24 INFO mapred.JobClient:   File Input Format Counters 
15/03/08 20:59:24 INFO mapred.JobClient:     Bytes Read=19202391
15/03/08 20:59:24 INFO mapred.JobClient:   Map-Reduce Framework
15/03/08 20:59:24 INFO mapred.JobClient:     Map input records=18846
15/03/08 20:59:24 INFO mapred.JobClient:     Physical memory (bytes) snapshot=84549632
15/03/08 20:59:24 INFO mapred.JobClient:     Spilled Records=0
15/03/08 20:59:24 INFO mapred.JobClient:     CPU time spent (ms)=15470
15/03/08 20:59:24 INFO mapred.JobClient:     Total committed heap usage (bytes)=23855104
15/03/08 20:59:24 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=724852736
15/03/08 20:59:24 INFO mapred.JobClient:     Map output records=18846
15/03/08 20:59:24 INFO mapred.JobClient:     SPLIT_RAW_BYTES=129
15/03/08 20:59:24 INFO vectorizer.SparseVectorsFromSequenceFiles: Creating Term Frequency Vectors
15/03/08 20:59:24 INFO vectorizer.DictionaryVectorizer: Creating dictionary from /tmp/mahout-work-grid/20news-vectors/tokenized-documents and saving at /tmp/mahout-work-grid/20news-vectors/wordcount
15/03/08 20:59:26 INFO input.FileInputFormat: Total input paths to process : 1
15/03/08 20:59:27 INFO mapred.JobClient: Running job: job_201503081659_0003
15/03/08 20:59:28 INFO mapred.JobClient:  map 0% reduce 0%
15/03/08 21:00:00 INFO mapred.JobClient:  map 32% reduce 0%
15/03/08 21:00:03 INFO mapred.JobClient:  map 58% reduce 0%
15/03/08 21:00:06 INFO mapred.JobClient:  map 90% reduce 0%
15/03/08 21:00:08 INFO mapred.JobClient:  map 100% reduce 0%
15/03/08 21:00:23 INFO mapred.JobClient:  map 100% reduce 100%
15/03/08 21:00:27 INFO mapred.JobClient: Job complete: job_201503081659_0003
15/03/08 21:00:27 INFO mapred.JobClient: Counters: 29
15/03/08 21:00:27 INFO mapred.JobClient:   Job Counters 
15/03/08 21:00:27 INFO mapred.JobClient:     Launched reduce tasks=1
15/03/08 21:00:27 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=37260
15/03/08 21:00:27 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/03/08 21:00:27 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/03/08 21:00:27 INFO mapred.JobClient:     Launched map tasks=1
15/03/08 21:00:27 INFO mapred.JobClient:     Data-local map tasks=1
15/03/08 21:00:27 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=14824
15/03/08 21:00:27 INFO mapred.JobClient:   File Output Format Counters 
15/03/08 21:00:27 INFO mapred.JobClient:     Bytes Written=2315037
15/03/08 21:00:27 INFO mapred.JobClient:   FileSystemCounters
15/03/08 21:00:27 INFO mapred.JobClient:     FILE_BYTES_READ=11857906
15/03/08 21:00:27 INFO mapred.JobClient:     HDFS_BYTES_READ=27503733
15/03/08 21:00:27 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=15513248
15/03/08 21:00:27 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=2315037
15/03/08 21:00:27 INFO mapred.JobClient:   File Input Format Counters 
15/03/08 21:00:27 INFO mapred.JobClient:     Bytes Read=27503580
15/03/08 21:00:27 INFO mapred.JobClient:   Map-Reduce Framework
15/03/08 21:00:27 INFO mapred.JobClient:     Map output materialized bytes=3538084
15/03/08 21:00:27 INFO mapred.JobClient:     Map input records=18846
15/03/08 21:00:27 INFO mapred.JobClient:     Reduce shuffle bytes=3538084
15/03/08 21:00:27 INFO mapred.JobClient:     Spilled Records=849345
15/03/08 21:00:27 INFO mapred.JobClient:     Map output bytes=39462740
15/03/08 21:00:27 INFO mapred.JobClient:     Total committed heap usage (bytes)=147394560
15/03/08 21:00:27 INFO mapred.JobClient:     CPU time spent (ms)=26820
15/03/08 21:00:27 INFO mapred.JobClient:     Combine input records=3026242
15/03/08 21:00:27 INFO mapred.JobClient:     SPLIT_RAW_BYTES=153
15/03/08 21:00:27 INFO mapred.JobClient:     Reduce input records=192904
15/03/08 21:00:27 INFO mapred.JobClient:     Reduce input groups=192904
15/03/08 21:00:27 INFO mapred.JobClient:     Combine output records=554873
15/03/08 21:00:27 INFO mapred.JobClient:     Physical memory (bytes) snapshot=278233088
15/03/08 21:00:27 INFO mapred.JobClient:     Reduce output records=93563
15/03/08 21:00:27 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=1456336896
15/03/08 21:00:27 INFO mapred.JobClient:     Map output records=2664273
15/03/08 21:00:32 INFO input.FileInputFormat: Total input paths to process : 1
15/03/08 21:00:33 INFO mapred.JobClient: Running job: job_201503081659_0004
15/03/08 21:00:34 INFO mapred.JobClient:  map 0% reduce 0%
15/03/08 21:01:09 INFO mapred.JobClient:  map 31% reduce 0%
15/03/08 21:01:12 INFO mapred.JobClient:  map 72% reduce 0%
15/03/08 21:01:15 INFO mapred.JobClient:  map 100% reduce 0%
15/03/08 21:01:33 INFO mapred.JobClient:  map 100% reduce 67%
15/03/08 21:01:36 INFO mapred.JobClient:  map 100% reduce 79%
15/03/08 21:01:39 INFO mapred.JobClient:  map 100% reduce 97%
15/03/08 21:01:40 INFO mapred.JobClient:  map 100% reduce 100%
15/03/08 21:01:46 INFO mapred.JobClient: Job complete: job_201503081659_0004
15/03/08 21:01:46 INFO mapred.JobClient: Counters: 29
15/03/08 21:01:46 INFO mapred.JobClient:   Job Counters 
15/03/08 21:01:46 INFO mapred.JobClient:     Launched reduce tasks=1
15/03/08 21:01:46 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=37702
15/03/08 21:01:46 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/03/08 21:01:46 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/03/08 21:01:46 INFO mapred.JobClient:     Launched map tasks=1
15/03/08 21:01:46 INFO mapred.JobClient:     Data-local map tasks=1
15/03/08 21:01:46 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=25246
15/03/08 21:01:46 INFO mapred.JobClient:   File Output Format Counters 
15/03/08 21:01:46 INFO mapred.JobClient:     Bytes Written=29314118
15/03/08 21:01:46 INFO mapred.JobClient:   FileSystemCounters
15/03/08 21:01:46 INFO mapred.JobClient:     FILE_BYTES_READ=29226519
15/03/08 21:01:46 INFO mapred.JobClient:     HDFS_BYTES_READ=27503733
15/03/08 21:01:46 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=54669982
15/03/08 21:01:46 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=29314118
15/03/08 21:01:46 INFO mapred.JobClient:   File Input Format Counters 
15/03/08 21:01:46 INFO mapred.JobClient:     Bytes Read=27503580
15/03/08 21:01:46 INFO mapred.JobClient:   Map-Reduce Framework
15/03/08 21:01:46 INFO mapred.JobClient:     Map output materialized bytes=27274291
15/03/08 21:01:46 INFO mapred.JobClient:     Map input records=18846
15/03/08 21:01:46 INFO mapred.JobClient:     Reduce shuffle bytes=27274291
15/03/08 21:01:46 INFO mapred.JobClient:     Spilled Records=37692
15/03/08 21:01:46 INFO mapred.JobClient:     Map output bytes=27199343
15/03/08 21:01:46 INFO mapred.JobClient:     Total committed heap usage (bytes)=174735360
15/03/08 21:01:46 INFO mapred.JobClient:     CPU time spent (ms)=33560
15/03/08 21:01:46 INFO mapred.JobClient:     Combine input records=0
15/03/08 21:01:46 INFO mapred.JobClient:     SPLIT_RAW_BYTES=153
15/03/08 21:01:46 INFO mapred.JobClient:     Reduce input records=18846
15/03/08 21:01:46 INFO mapred.JobClient:     Reduce input groups=18846
15/03/08 21:01:46 INFO mapred.JobClient:     Combine output records=0
15/03/08 21:01:46 INFO mapred.JobClient:     Physical memory (bytes) snapshot=310116352
15/03/08 21:01:46 INFO mapred.JobClient:     Reduce output records=18846
15/03/08 21:01:46 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=1474854912
15/03/08 21:01:46 INFO mapred.JobClient:     Map output records=18846
15/03/08 21:01:48 INFO input.FileInputFormat: Total input paths to process : 1
15/03/08 21:01:49 INFO mapred.JobClient: Running job: job_201503081659_0005
15/03/08 21:01:50 INFO mapred.JobClient:  map 0% reduce 0%
15/03/08 21:02:17 INFO mapred.JobClient:  map 100% reduce 0%
15/03/08 21:02:30 INFO mapred.JobClient:  map 100% reduce 71%
15/03/08 21:02:33 INFO mapred.JobClient:  map 100% reduce 99%
15/03/08 21:02:35 INFO mapred.JobClient:  map 100% reduce 100%
15/03/08 21:02:39 INFO mapred.JobClient: Job complete: job_201503081659_0005
15/03/08 21:02:39 INFO mapred.JobClient: Counters: 29
15/03/08 21:02:39 INFO mapred.JobClient:   Job Counters 
15/03/08 21:02:39 INFO mapred.JobClient:     Launched reduce tasks=1
15/03/08 21:02:39 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=27104
15/03/08 21:02:39 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/03/08 21:02:39 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/03/08 21:02:39 INFO mapred.JobClient:     Launched map tasks=1
15/03/08 21:02:39 INFO mapred.JobClient:     Data-local map tasks=1
15/03/08 21:02:39 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=18088
15/03/08 21:02:39 INFO mapred.JobClient:   File Output Format Counters 
15/03/08 21:02:39 INFO mapred.JobClient:     Bytes Written=29314118
15/03/08 21:02:39 INFO mapred.JobClient:   FileSystemCounters
15/03/08 21:02:39 INFO mapred.JobClient:     FILE_BYTES_READ=29059398
15/03/08 21:02:39 INFO mapred.JobClient:     HDFS_BYTES_READ=29314269
15/03/08 21:02:39 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=58236992
15/03/08 21:02:39 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=29314118
15/03/08 21:02:39 INFO mapred.JobClient:   File Input Format Counters 
15/03/08 21:02:39 INFO mapred.JobClient:     Bytes Read=29314118
15/03/08 21:02:39 INFO mapred.JobClient:   Map-Reduce Framework
15/03/08 21:02:39 INFO mapred.JobClient:     Map output materialized bytes=29059398
15/03/08 21:02:39 INFO mapred.JobClient:     Map input records=18846
15/03/08 21:02:39 INFO mapred.JobClient:     Reduce shuffle bytes=29059398
15/03/08 21:02:39 INFO mapred.JobClient:     Spilled Records=37692
15/03/08 21:02:39 INFO mapred.JobClient:     Map output bytes=28984080
15/03/08 21:02:39 INFO mapred.JobClient:     Total committed heap usage (bytes)=176521216
15/03/08 21:02:39 INFO mapred.JobClient:     CPU time spent (ms)=21310
15/03/08 21:02:39 INFO mapred.JobClient:     Combine input records=0
15/03/08 21:02:39 INFO mapred.JobClient:     SPLIT_RAW_BYTES=151
15/03/08 21:02:39 INFO mapred.JobClient:     Reduce input records=18846
15/03/08 21:02:39 INFO mapred.JobClient:     Reduce input groups=18846
15/03/08 21:02:39 INFO mapred.JobClient:     Combine output records=0
15/03/08 21:02:39 INFO mapred.JobClient:     Physical memory (bytes) snapshot=305786880
15/03/08 21:02:39 INFO mapred.JobClient:     Reduce output records=18846
15/03/08 21:02:39 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=1476845568
15/03/08 21:02:39 INFO mapred.JobClient:     Map output records=18846
15/03/08 21:02:39 INFO common.HadoopUtil: Deleting /tmp/mahout-work-grid/20news-vectors/partial-vectors-0
15/03/08 21:02:39 INFO vectorizer.SparseVectorsFromSequenceFiles: Calculating IDF
15/03/08 21:02:42 INFO input.FileInputFormat: Total input paths to process : 1
15/03/08 21:02:43 INFO mapred.JobClient: Running job: job_201503081659_0006
15/03/08 21:02:44 INFO mapred.JobClient:  map 0% reduce 0%
15/03/08 21:03:08 INFO mapred.JobClient:  map 47% reduce 0%
15/03/08 21:03:11 INFO mapred.JobClient:  map 88% reduce 0%
15/03/08 21:03:13 INFO mapred.JobClient:  map 100% reduce 0%
15/03/08 21:03:23 INFO mapred.JobClient:  map 100% reduce 33%
15/03/08 21:03:27 INFO mapred.JobClient:  map 100% reduce 100%
15/03/08 21:03:31 INFO mapred.JobClient: Job complete: job_201503081659_0006
15/03/08 21:03:31 INFO mapred.JobClient: Counters: 29
15/03/08 21:03:31 INFO mapred.JobClient:   Job Counters 
15/03/08 21:03:31 INFO mapred.JobClient:     Launched reduce tasks=1
15/03/08 21:03:31 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=29689
15/03/08 21:03:31 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/03/08 21:03:31 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/03/08 21:03:31 INFO mapred.JobClient:     Launched map tasks=1
15/03/08 21:03:31 INFO mapred.JobClient:     Data-local map tasks=1
15/03/08 21:03:31 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=13909
15/03/08 21:03:31 INFO mapred.JobClient:   File Output Format Counters 
15/03/08 21:03:31 INFO mapred.JobClient:     Bytes Written=1890073
15/03/08 21:03:31 INFO mapred.JobClient:   FileSystemCounters
15/03/08 21:03:31 INFO mapred.JobClient:     FILE_BYTES_READ=4880830
15/03/08 21:03:31 INFO mapred.JobClient:     HDFS_BYTES_READ=29314270
15/03/08 21:03:31 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=6307710
15/03/08 21:03:31 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=1890073
15/03/08 21:03:31 INFO mapred.JobClient:   File Input Format Counters 
15/03/08 21:03:31 INFO mapred.JobClient:     Bytes Read=29314118
15/03/08 21:03:31 INFO mapred.JobClient:   Map-Reduce Framework
15/03/08 21:03:31 INFO mapred.JobClient:     Map output materialized bytes=1309902
15/03/08 21:03:31 INFO mapred.JobClient:     Map input records=18846
15/03/08 21:03:31 INFO mapred.JobClient:     Reduce shuffle bytes=1309902
15/03/08 21:03:31 INFO mapred.JobClient:     Spilled Records=442190
15/03/08 21:03:31 INFO mapred.JobClient:     Map output bytes=31005336
15/03/08 21:03:31 INFO mapred.JobClient:     Total committed heap usage (bytes)=147394560
15/03/08 21:03:31 INFO mapred.JobClient:     CPU time spent (ms)=23130
15/03/08 21:03:31 INFO mapred.JobClient:     Combine input records=2838840
15/03/08 21:03:31 INFO mapred.JobClient:     SPLIT_RAW_BYTES=152
15/03/08 21:03:31 INFO mapred.JobClient:     Reduce input records=93564
15/03/08 21:03:31 INFO mapred.JobClient:     Reduce input groups=93564
15/03/08 21:03:31 INFO mapred.JobClient:     Combine output records=348626
15/03/08 21:03:31 INFO mapred.JobClient:     Physical memory (bytes) snapshot=281788416
15/03/08 21:03:31 INFO mapred.JobClient:     Reduce output records=93564
15/03/08 21:03:31 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=1457623040
15/03/08 21:03:31 INFO mapred.JobClient:     Map output records=2583778
15/03/08 21:03:32 INFO vectorizer.SparseVectorsFromSequenceFiles: Pruning
15/03/08 21:03:33 INFO input.FileInputFormat: Total input paths to process : 1
15/03/08 21:03:34 INFO mapred.JobClient: Running job: job_201503081659_0007
15/03/08 21:03:35 INFO mapred.JobClient:  map 0% reduce 0%
15/03/08 21:03:58 INFO mapred.JobClient:  map 40% reduce 0%
15/03/08 21:04:01 INFO mapred.JobClient:  map 100% reduce 0%
15/03/08 21:04:26 INFO mapred.JobClient:  map 100% reduce 33%
15/03/08 21:04:30 INFO mapred.JobClient:  map 100% reduce 66%
15/03/08 21:04:33 INFO mapred.JobClient:  map 100% reduce 69%
15/03/08 21:04:36 INFO mapred.JobClient:  map 100% reduce 73%
15/03/08 21:04:38 INFO mapred.JobClient:  map 100% reduce 100%
15/03/08 21:04:45 INFO mapred.JobClient: Job complete: job_201503081659_0007
15/03/08 21:04:45 INFO mapred.JobClient: Counters: 29
15/03/08 21:04:45 INFO mapred.JobClient:   Job Counters 
15/03/08 21:04:45 INFO mapred.JobClient:     Launched reduce tasks=1
15/03/08 21:04:45 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=33546
15/03/08 21:04:45 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/03/08 21:04:45 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/03/08 21:04:45 INFO mapred.JobClient:     Launched map tasks=1
15/03/08 21:04:45 INFO mapred.JobClient:     Data-local map tasks=1
15/03/08 21:04:45 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=32143
15/03/08 21:04:45 INFO mapred.JobClient:   File Output Format Counters 
15/03/08 21:04:45 INFO mapred.JobClient:     Bytes Written=28689283
15/03/08 21:04:45 INFO mapred.JobClient:   FileSystemCounters
15/03/08 21:04:45 INFO mapred.JobClient:     FILE_BYTES_READ=9646422
15/03/08 21:04:45 INFO mapred.JobClient:     HDFS_BYTES_READ=29314270
15/03/08 21:04:45 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=15602818
15/03/08 21:04:45 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=28689283
15/03/08 21:04:45 INFO mapred.JobClient:   File Input Format Counters 
15/03/08 21:04:45 INFO mapred.JobClient:     Bytes Read=29314118
15/03/08 21:04:45 INFO mapred.JobClient:   Map-Reduce Framework
15/03/08 21:04:45 INFO mapred.JobClient:     Map output materialized bytes=7741585
15/03/08 21:04:45 INFO mapred.JobClient:     Map input records=18846
15/03/08 21:04:45 INFO mapred.JobClient:     Reduce shuffle bytes=7741585
15/03/08 21:04:45 INFO mapred.JobClient:     Spilled Records=37692
15/03/08 21:04:45 INFO mapred.JobClient:     Map output bytes=28984080
15/03/08 21:04:45 INFO mapred.JobClient:     Total committed heap usage (bytes)=176521216
15/03/08 21:04:45 INFO mapred.JobClient:     CPU time spent (ms)=49000
15/03/08 21:04:45 INFO mapred.JobClient:     Combine input records=0
15/03/08 21:04:45 INFO mapred.JobClient:     SPLIT_RAW_BYTES=152
15/03/08 21:04:45 INFO mapred.JobClient:     Reduce input records=18846
15/03/08 21:04:45 INFO mapred.JobClient:     Reduce input groups=18846
15/03/08 21:04:45 INFO mapred.JobClient:     Combine output records=0
15/03/08 21:04:45 INFO mapred.JobClient:     Physical memory (bytes) snapshot=305831936
15/03/08 21:04:45 INFO mapred.JobClient:     Reduce output records=18846
15/03/08 21:04:45 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=1458589696
15/03/08 21:04:45 INFO mapred.JobClient:     Map output records=18846
15/03/08 21:04:47 INFO input.FileInputFormat: Total input paths to process : 1
15/03/08 21:04:48 INFO mapred.JobClient: Running job: job_201503081659_0008
15/03/08 21:04:49 INFO mapred.JobClient:  map 0% reduce 0%
15/03/08 21:05:18 INFO mapred.JobClient:  map 92% reduce 0%
15/03/08 21:05:20 INFO mapred.JobClient:  map 100% reduce 0%
15/03/08 21:05:40 INFO mapred.JobClient:  map 100% reduce 71%
15/03/08 21:05:44 INFO mapred.JobClient:  map 100% reduce 87%
15/03/08 21:05:47 INFO mapred.JobClient:  map 100% reduce 100%
15/03/08 21:05:55 INFO mapred.JobClient: Job complete: job_201503081659_0008
15/03/08 21:05:55 INFO mapred.JobClient: Counters: 29
15/03/08 21:05:55 INFO mapred.JobClient:   Job Counters 
15/03/08 21:05:55 INFO mapred.JobClient:     Launched reduce tasks=1
15/03/08 21:05:55 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=35779
15/03/08 21:05:55 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/03/08 21:05:55 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/03/08 21:05:55 INFO mapred.JobClient:     Launched map tasks=1
15/03/08 21:05:55 INFO mapred.JobClient:     Data-local map tasks=1
15/03/08 21:05:55 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=26799
15/03/08 21:05:55 INFO mapred.JobClient:   File Output Format Counters 
15/03/08 21:05:55 INFO mapred.JobClient:     Bytes Written=28689283
15/03/08 21:05:55 INFO mapred.JobClient:   FileSystemCounters
15/03/08 21:05:55 INFO mapred.JobClient:     FILE_BYTES_READ=28437750
15/03/08 21:05:55 INFO mapred.JobClient:     HDFS_BYTES_READ=28689445
15/03/08 21:05:55 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=56992598
15/03/08 21:05:55 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=28689283
15/03/08 21:05:55 INFO mapred.JobClient:   File Input Format Counters 
15/03/08 21:05:55 INFO mapred.JobClient:     Bytes Read=28689283
15/03/08 21:05:55 INFO mapred.JobClient:   Map-Reduce Framework
15/03/08 21:05:55 INFO mapred.JobClient:     Map output materialized bytes=28437750
15/03/08 21:05:55 INFO mapred.JobClient:     Map input records=18846
15/03/08 21:05:55 INFO mapred.JobClient:     Reduce shuffle bytes=28437750
15/03/08 21:05:55 INFO mapred.JobClient:     Spilled Records=37692
15/03/08 21:05:55 INFO mapred.JobClient:     Map output bytes=28362505
15/03/08 21:05:55 INFO mapred.JobClient:     Total committed heap usage (bytes)=175898624
15/03/08 21:05:55 INFO mapred.JobClient:     CPU time spent (ms)=34270
15/03/08 21:05:55 INFO mapred.JobClient:     Combine input records=0
15/03/08 21:05:55 INFO mapred.JobClient:     SPLIT_RAW_BYTES=162
15/03/08 21:05:55 INFO mapred.JobClient:     Reduce input records=18846
15/03/08 21:05:55 INFO mapred.JobClient:     Reduce input groups=18846
15/03/08 21:05:55 INFO mapred.JobClient:     Combine output records=0
15/03/08 21:05:55 INFO mapred.JobClient:     Physical memory (bytes) snapshot=290082816
15/03/08 21:05:55 INFO mapred.JobClient:     Reduce output records=18846
15/03/08 21:05:55 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=1465872384
15/03/08 21:05:55 INFO mapred.JobClient:     Map output records=18846
15/03/08 21:05:55 INFO common.HadoopUtil: Deleting /tmp/mahout-work-grid/20news-vectors/tf-vectors-partial
15/03/08 21:05:55 INFO common.HadoopUtil: Deleting /tmp/mahout-work-grid/20news-vectors/tf-vectors-toprune
15/03/08 21:05:58 INFO input.FileInputFormat: Total input paths to process : 1
15/03/08 21:05:59 INFO mapred.JobClient: Running job: job_201503081659_0009
15/03/08 21:06:00 INFO mapred.JobClient:  map 0% reduce 0%
15/03/08 21:06:24 INFO mapred.JobClient:  map 100% reduce 0%
15/03/08 21:06:37 INFO mapred.JobClient:  map 100% reduce 68%
15/03/08 21:06:40 INFO mapred.JobClient:  map 100% reduce 87%
15/03/08 21:06:43 INFO mapred.JobClient:  map 100% reduce 100%
15/03/08 21:06:47 INFO mapred.JobClient: Job complete: job_201503081659_0009
15/03/08 21:06:47 INFO mapred.JobClient: Counters: 29
15/03/08 21:06:47 INFO mapred.JobClient:   Job Counters 
15/03/08 21:06:47 INFO mapred.JobClient:     Launched reduce tasks=1
15/03/08 21:06:47 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=21911
15/03/08 21:06:47 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/03/08 21:06:48 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/03/08 21:06:48 INFO mapred.JobClient:     Launched map tasks=1
15/03/08 21:06:48 INFO mapred.JobClient:     Data-local map tasks=1
15/03/08 21:06:48 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=19167
15/03/08 21:06:48 INFO mapred.JobClient:   File Output Format Counters 
15/03/08 21:06:48 INFO mapred.JobClient:     Bytes Written=28689283
15/03/08 21:06:48 INFO mapred.JobClient:   FileSystemCounters
15/03/08 21:06:48 INFO mapred.JobClient:     FILE_BYTES_READ=30342579
15/03/08 21:06:48 INFO mapred.JobClient:     HDFS_BYTES_READ=28689427
15/03/08 21:06:48 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=56996636
15/03/08 21:06:48 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=28689283
15/03/08 21:06:48 INFO mapred.JobClient:   File Input Format Counters 
15/03/08 21:06:48 INFO mapred.JobClient:     Bytes Read=28689283
15/03/08 21:06:48 INFO mapred.JobClient:   Map-Reduce Framework
15/03/08 21:06:48 INFO mapred.JobClient:     Map output materialized bytes=28437750
15/03/08 21:06:48 INFO mapred.JobClient:     Map input records=18846
15/03/08 21:06:48 INFO mapred.JobClient:     Reduce shuffle bytes=28437750
15/03/08 21:06:48 INFO mapred.JobClient:     Spilled Records=37692
15/03/08 21:06:48 INFO mapred.JobClient:     Map output bytes=28362505
15/03/08 21:06:48 INFO mapred.JobClient:     Total committed heap usage (bytes)=175898624
15/03/08 21:06:48 INFO mapred.JobClient:     CPU time spent (ms)=23140
15/03/08 21:06:48 INFO mapred.JobClient:     Combine input records=0
15/03/08 21:06:48 INFO mapred.JobClient:     SPLIT_RAW_BYTES=144
15/03/08 21:06:48 INFO mapred.JobClient:     Reduce input records=18846
15/03/08 21:06:48 INFO mapred.JobClient:     Reduce input groups=18846
15/03/08 21:06:48 INFO mapred.JobClient:     Combine output records=0
15/03/08 21:06:48 INFO mapred.JobClient:     Physical memory (bytes) snapshot=308453376
15/03/08 21:06:48 INFO mapred.JobClient:     Reduce output records=18846
15/03/08 21:06:48 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=1454231552
15/03/08 21:06:48 INFO mapred.JobClient:     Map output records=18846
15/03/08 21:06:49 INFO input.FileInputFormat: Total input paths to process : 1
15/03/08 21:06:50 INFO mapred.JobClient: Running job: job_201503081659_0010
15/03/08 21:06:51 INFO mapred.JobClient:  map 0% reduce 0%
15/03/08 21:07:12 INFO mapred.JobClient:  map 100% reduce 0%
15/03/08 21:07:25 INFO mapred.JobClient:  map 100% reduce 71%
15/03/08 21:07:28 INFO mapred.JobClient:  map 100% reduce 100%
15/03/08 21:07:33 INFO mapred.JobClient: Job complete: job_201503081659_0010
15/03/08 21:07:33 INFO mapred.JobClient: Counters: 29
15/03/08 21:07:33 INFO mapred.JobClient:   Job Counters 
15/03/08 21:07:33 INFO mapred.JobClient:     Launched reduce tasks=1
15/03/08 21:07:33 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=20931
15/03/08 21:07:33 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/03/08 21:07:33 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/03/08 21:07:33 INFO mapred.JobClient:     Launched map tasks=1
15/03/08 21:07:33 INFO mapred.JobClient:     Data-local map tasks=1
15/03/08 21:07:33 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=17614
15/03/08 21:07:33 INFO mapred.JobClient:   File Output Format Counters 
15/03/08 21:07:33 INFO mapred.JobClient:     Bytes Written=28689283
15/03/08 21:07:33 INFO mapred.JobClient:   FileSystemCounters
15/03/08 21:07:33 INFO mapred.JobClient:     FILE_BYTES_READ=28437750
15/03/08 21:07:33 INFO mapred.JobClient:     HDFS_BYTES_READ=28689434
15/03/08 21:07:33 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=56993684
15/03/08 21:07:33 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=28689283
15/03/08 21:07:33 INFO mapred.JobClient:   File Input Format Counters 
15/03/08 21:07:33 INFO mapred.JobClient:     Bytes Read=28689283
15/03/08 21:07:33 INFO mapred.JobClient:   Map-Reduce Framework
15/03/08 21:07:33 INFO mapred.JobClient:     Map output materialized bytes=28437750
15/03/08 21:07:33 INFO mapred.JobClient:     Map input records=18846
15/03/08 21:07:33 INFO mapred.JobClient:     Reduce shuffle bytes=28437750
15/03/08 21:07:33 INFO mapred.JobClient:     Spilled Records=37692
15/03/08 21:07:33 INFO mapred.JobClient:     Map output bytes=28362505
15/03/08 21:07:33 INFO mapred.JobClient:     Total committed heap usage (bytes)=175898624
15/03/08 21:07:33 INFO mapred.JobClient:     CPU time spent (ms)=20320
15/03/08 21:07:33 INFO mapred.JobClient:     Combine input records=0
15/03/08 21:07:33 INFO mapred.JobClient:     SPLIT_RAW_BYTES=151
15/03/08 21:07:33 INFO mapred.JobClient:     Reduce input records=18846
15/03/08 21:07:33 INFO mapred.JobClient:     Reduce input groups=18846
15/03/08 21:07:33 INFO mapred.JobClient:     Combine output records=0
15/03/08 21:07:33 INFO mapred.JobClient:     Physical memory (bytes) snapshot=298102784
15/03/08 21:07:33 INFO mapred.JobClient:     Reduce output records=18846
15/03/08 21:07:33 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=1454256128
15/03/08 21:07:33 INFO mapred.JobClient:     Map output records=18846
15/03/08 21:07:33 INFO common.HadoopUtil: Deleting /tmp/mahout-work-grid/20news-vectors/partial-vectors-0
15/03/08 21:07:33 INFO driver.MahoutDriver: Program took 529754 ms (Minutes: 8.829233333333333)
+ echo 'Creating training and holdout set with a random 80-20 split of the generated vector dataset'
Creating training and holdout set with a random 80-20 split of the generated vector dataset
+ ./bin/mahout split -i /tmp/mahout-work-grid/20news-vectors/tfidf-vectors --trainingOutput /tmp/mahout-work-grid/20news-train-vectors --testOutput /tmp/mahout-work-grid/20news-test-vectors --randomSelectionPct 40 --overwrite --sequenceFiles -xm sequential
MAHOUT_LOCAL is not set; adding HADOOP_CONF_DIR to classpath.
Warning: $HADOOP_HOME is deprecated.

Running on hadoop, using /home/grid/hadoop-1.2.1/bin/hadoop and HADOOP_CONF_DIR=/home/grid/hadoop-1.2.1/conf
MAHOUT-JOB: /home/grid/mahout-distribution-0.9/mahout-examples-0.9-job.jar
Warning: $HADOOP_HOME is deprecated.

15/03/08 21:07:40 WARN driver.MahoutDriver: No split.props found on classpath, will use command-line arguments only
15/03/08 21:07:41 INFO common.AbstractJob: Command line arguments: {--endPhase=[2147483647], --input=[/tmp/mahout-work-grid/20news-vectors/tfidf-vectors], --method=[sequential], --overwrite=null, --randomSelectionPct=[40], --sequenceFiles=null, --startPhase=[0], --tempDir=[temp], --testOutput=[/tmp/mahout-work-grid/20news-test-vectors], --trainingOutput=[/tmp/mahout-work-grid/20news-train-vectors]}
15/03/08 21:07:46 INFO utils.SplitInput: part-r-00000 has 162419 lines
15/03/08 21:07:46 INFO utils.SplitInput: part-r-00000 test split size is 64968 based on random selection percentage 40
15/03/08 21:07:46 INFO util.NativeCodeLoader: Loaded the native-hadoop library
15/03/08 21:07:46 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
15/03/08 21:07:46 INFO compress.CodecPool: Got brand-new compressor
15/03/08 21:07:46 INFO compress.CodecPool: Got brand-new compressor
15/03/08 21:08:01 INFO utils.SplitInput: file: part-r-00000, input: 162419 train: 11441, test: 7405 starting at 0
15/03/08 21:08:01 INFO driver.MahoutDriver: Program took 20712 ms (Minutes: 0.3452)
+ echo 'Training Naive Bayes model'
Training Naive Bayes model
+ ./bin/mahout trainnb -i /tmp/mahout-work-grid/20news-train-vectors -el -o /tmp/mahout-work-grid/model -li /tmp/mahout-work-grid/labelindex -ow -c
MAHOUT_LOCAL is not set; adding HADOOP_CONF_DIR to classpath.
Warning: $HADOOP_HOME is deprecated.

Running on hadoop, using /home/grid/hadoop-1.2.1/bin/hadoop and HADOOP_CONF_DIR=/home/grid/hadoop-1.2.1/conf
MAHOUT-JOB: /home/grid/mahout-distribution-0.9/mahout-examples-0.9-job.jar
Warning: $HADOOP_HOME is deprecated.

15/03/08 21:08:13 WARN driver.MahoutDriver: No trainnb.props found on classpath, will use command-line arguments only
15/03/08 21:08:14 INFO common.AbstractJob: Command line arguments: {--alphaI=[1.0], --endPhase=[2147483647], --extractLabels=null, --input=[/tmp/mahout-work-grid/20news-train-vectors], --labelIndex=[/tmp/mahout-work-grid/labelindex], --output=[/tmp/mahout-work-grid/model], --overwrite=null, --startPhase=[0], --tempDir=[temp], --trainComplementary=null}
15/03/08 21:08:16 INFO util.NativeCodeLoader: Loaded the native-hadoop library
15/03/08 21:08:16 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
15/03/08 21:08:17 INFO compress.CodecPool: Got brand-new decompressor
15/03/08 21:08:26 INFO input.FileInputFormat: Total input paths to process : 1
15/03/08 21:08:28 INFO mapred.JobClient: Running job: job_201503081659_0011
15/03/08 21:08:29 INFO mapred.JobClient:  map 0% reduce 0%
15/03/08 21:08:54 INFO mapred.JobClient:  map 100% reduce 0%
15/03/08 21:09:09 INFO mapred.JobClient:  map 100% reduce 100%
15/03/08 21:09:13 INFO mapred.JobClient: Job complete: job_201503081659_0011
15/03/08 21:09:14 INFO mapred.JobClient: Counters: 29
15/03/08 21:09:14 INFO mapred.JobClient:   Job Counters 
15/03/08 21:09:14 INFO mapred.JobClient:     Launched reduce tasks=1
15/03/08 21:09:14 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=24934
15/03/08 21:09:14 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/03/08 21:09:14 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/03/08 21:09:14 INFO mapred.JobClient:     Launched map tasks=1
15/03/08 21:09:14 INFO mapred.JobClient:     Data-local map tasks=1
15/03/08 21:09:14 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=13530
15/03/08 21:09:14 INFO mapred.JobClient:   File Output Format Counters 
15/03/08 21:09:14 INFO mapred.JobClient:     Bytes Written=2757285
15/03/08 21:09:14 INFO mapred.JobClient:   FileSystemCounters
15/03/08 21:09:14 INFO mapred.JobClient:     FILE_BYTES_READ=1527193
15/03/08 21:09:14 INFO mapred.JobClient:     HDFS_BYTES_READ=12920362
15/03/08 21:09:14 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=3173016
15/03/08 21:09:14 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=2757285
15/03/08 21:09:14 INFO mapred.JobClient:   File Input Format Counters 
15/03/08 21:09:14 INFO mapred.JobClient:     Bytes Read=12920223
15/03/08 21:09:14 INFO mapred.JobClient:   Map-Reduce Framework
15/03/08 21:09:14 INFO mapred.JobClient:     Map output materialized bytes=1526511
15/03/08 21:09:14 INFO mapred.JobClient:     Map input records=11441
15/03/08 21:09:14 INFO mapred.JobClient:     Reduce shuffle bytes=1526511
15/03/08 21:09:14 INFO mapred.JobClient:     Spilled Records=40
15/03/08 21:09:14 INFO mapred.JobClient:     Map output bytes=16896230
15/03/08 21:09:14 INFO mapred.JobClient:     Total committed heap usage (bytes)=147394560
15/03/08 21:09:14 INFO mapred.JobClient:     CPU time spent (ms)=16930
15/03/08 21:09:14 INFO mapred.JobClient:     Combine input records=11441
15/03/08 21:09:14 INFO mapred.JobClient:     SPLIT_RAW_BYTES=139
15/03/08 21:09:14 INFO mapred.JobClient:     Reduce input records=20
15/03/08 21:09:14 INFO mapred.JobClient:     Reduce input groups=20
15/03/08 21:09:14 INFO mapred.JobClient:     Combine output records=20
15/03/08 21:09:14 INFO mapred.JobClient:     Physical memory (bytes) snapshot=275156992
15/03/08 21:09:14 INFO mapred.JobClient:     Reduce output records=20
15/03/08 21:09:14 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=1458122752
15/03/08 21:09:14 INFO mapred.JobClient:     Map output records=11441
15/03/08 21:09:15 INFO input.FileInputFormat: Total input paths to process : 1
15/03/08 21:09:16 INFO mapred.JobClient: Running job: job_201503081659_0012
15/03/08 21:09:17 INFO mapred.JobClient:  map 0% reduce 0%
15/03/08 21:09:32 INFO mapred.JobClient:  map 100% reduce 0%
15/03/08 21:09:42 INFO mapred.JobClient:  map 100% reduce 33%
15/03/08 21:09:45 INFO mapred.JobClient:  map 100% reduce 100%
15/03/08 21:09:49 INFO mapred.JobClient: Job complete: job_201503081659_0012
15/03/08 21:09:49 INFO mapred.JobClient: Counters: 29
15/03/08 21:09:49 INFO mapred.JobClient:   Job Counters 
15/03/08 21:09:49 INFO mapred.JobClient:     Launched reduce tasks=1
15/03/08 21:09:49 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=15773
15/03/08 21:09:49 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/03/08 21:09:49 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/03/08 21:09:49 INFO mapred.JobClient:     Launched map tasks=1
15/03/08 21:09:49 INFO mapred.JobClient:     Data-local map tasks=1
15/03/08 21:09:49 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=12833
15/03/08 21:09:49 INFO mapred.JobClient:   File Output Format Counters 
15/03/08 21:09:49 INFO mapred.JobClient:     Bytes Written=891489
15/03/08 21:09:49 INFO mapred.JobClient:   FileSystemCounters
15/03/08 21:09:49 INFO mapred.JobClient:     FILE_BYTES_READ=441934
15/03/08 21:09:49 INFO mapred.JobClient:     HDFS_BYTES_READ=2757416
15/03/08 21:09:49 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=1004208
15/03/08 21:09:49 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=891489
15/03/08 21:09:49 INFO mapred.JobClient:   File Input Format Counters 
15/03/08 21:09:49 INFO mapred.JobClient:     Bytes Read=2757285
15/03/08 21:09:49 INFO mapred.JobClient:   Map-Reduce Framework
15/03/08 21:09:49 INFO mapred.JobClient:     Map output materialized bytes=441926
15/03/08 21:09:49 INFO mapred.JobClient:     Map input records=20
15/03/08 21:09:49 INFO mapred.JobClient:     Reduce shuffle bytes=441926
15/03/08 21:09:49 INFO mapred.JobClient:     Spilled Records=4
15/03/08 21:09:49 INFO mapred.JobClient:     Map output bytes=891363
15/03/08 21:09:49 INFO mapred.JobClient:     Total committed heap usage (bytes)=226623488
15/03/08 21:09:49 INFO mapred.JobClient:     CPU time spent (ms)=8220
15/03/08 21:09:49 INFO mapred.JobClient:     Combine input records=2
15/03/08 21:09:49 INFO mapred.JobClient:     SPLIT_RAW_BYTES=131
15/03/08 21:09:49 INFO mapred.JobClient:     Reduce input records=2
15/03/08 21:09:49 INFO mapred.JobClient:     Reduce input groups=2
15/03/08 21:09:49 INFO mapred.JobClient:     Combine output records=2
15/03/08 21:09:49 INFO mapred.JobClient:     Physical memory (bytes) snapshot=293044224
15/03/08 21:09:49 INFO mapred.JobClient:     Reduce output records=2
15/03/08 21:09:49 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=1475592192
15/03/08 21:09:49 INFO mapred.JobClient:     Map output records=2
15/03/08 21:09:51 INFO driver.MahoutDriver: Program took 97669 ms (Minutes: 1.6278333333333332)
+ echo 'Self testing on training set'
Self testing on training set
+ ./bin/mahout testnb -i /tmp/mahout-work-grid/20news-train-vectors -m /tmp/mahout-work-grid/model -l /tmp/mahout-work-grid/labelindex -ow -o /tmp/mahout-work-grid/20news-testing -c
MAHOUT_LOCAL is not set; adding HADOOP_CONF_DIR to classpath.
Warning: $HADOOP_HOME is deprecated.

Running on hadoop, using /home/grid/hadoop-1.2.1/bin/hadoop and HADOOP_CONF_DIR=/home/grid/hadoop-1.2.1/conf
MAHOUT-JOB: /home/grid/mahout-distribution-0.9/mahout-examples-0.9-job.jar
Warning: $HADOOP_HOME is deprecated.

15/03/08 21:09:57 WARN driver.MahoutDriver: No testnb.props found on classpath, will use command-line arguments only
15/03/08 21:09:58 INFO common.AbstractJob: Command line arguments: {--endPhase=[2147483647], --input=[/tmp/mahout-work-grid/20news-train-vectors], --labelIndex=[/tmp/mahout-work-grid/labelindex], --model=[/tmp/mahout-work-grid/model], --output=[/tmp/mahout-work-grid/20news-testing], --overwrite=null, --startPhase=[0], --tempDir=[temp], --testComplementary=null}
15/03/08 21:10:01 INFO input.FileInputFormat: Total input paths to process : 1
15/03/08 21:10:02 INFO mapred.JobClient: Running job: job_201503081659_0013
15/03/08 21:10:03 INFO mapred.JobClient:  map 0% reduce 0%
15/03/08 21:10:23 INFO mapred.JobClient:  map 20% reduce 0%
15/03/08 21:10:26 INFO mapred.JobClient:  map 36% reduce 0%
15/03/08 21:10:29 INFO mapred.JobClient:  map 54% reduce 0%
15/03/08 21:10:32 INFO mapred.JobClient:  map 71% reduce 0%
15/03/08 21:10:35 INFO mapred.JobClient:  map 89% reduce 0%
15/03/08 21:10:38 INFO mapred.JobClient:  map 100% reduce 0%
15/03/08 21:10:42 INFO mapred.JobClient: Job complete: job_201503081659_0013
15/03/08 21:10:42 INFO mapred.JobClient: Counters: 20
15/03/08 21:10:42 INFO mapred.JobClient:   Job Counters 
15/03/08 21:10:42 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=34759
15/03/08 21:10:42 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/03/08 21:10:42 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/03/08 21:10:42 INFO mapred.JobClient:     Launched map tasks=1
15/03/08 21:10:42 INFO mapred.JobClient:     Data-local map tasks=1
15/03/08 21:10:42 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0
15/03/08 21:10:42 INFO mapred.JobClient:   File Output Format Counters 
15/03/08 21:10:42 INFO mapred.JobClient:     Bytes Written=2155560
15/03/08 21:10:42 INFO mapred.JobClient:   FileSystemCounters
15/03/08 21:10:42 INFO mapred.JobClient:     FILE_BYTES_READ=3676597
15/03/08 21:10:42 INFO mapred.JobClient:     HDFS_BYTES_READ=12920362
15/03/08 21:10:42 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=59447
15/03/08 21:10:42 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=2155560
15/03/08 21:10:42 INFO mapred.JobClient:   File Input Format Counters 
15/03/08 21:10:42 INFO mapred.JobClient:     Bytes Read=12920223
15/03/08 21:10:42 INFO mapred.JobClient:   Map-Reduce Framework
15/03/08 21:10:42 INFO mapred.JobClient:     Map input records=11441
15/03/08 21:10:42 INFO mapred.JobClient:     Physical memory (bytes) snapshot=99229696
15/03/08 21:10:42 INFO mapred.JobClient:     Spilled Records=0
15/03/08 21:10:42 INFO mapred.JobClient:     CPU time spent (ms)=25750
15/03/08 21:10:42 INFO mapred.JobClient:     Total committed heap usage (bytes)=35360768
15/03/08 21:10:42 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=724860928
15/03/08 21:10:42 INFO mapred.JobClient:     Map output records=11441
15/03/08 21:10:42 INFO mapred.JobClient:     SPLIT_RAW_BYTES=139
15/03/08 21:10:44 INFO test.TestNaiveBayesDriver: Complementary Results: 
=======================================================
Summary
-------------------------------------------------------
Correctly Classified Instances          :      11313	   98.8812%
Incorrectly Classified Instances        :        128	    1.1188%
Total Classified Instances              :      11441

=======================================================
Confusion Matrix
-------------------------------------------------------
a    	b    	c    	d    	e    	f    	g    	h    	i    	j    	k    	l    	m    	n     o    	p    	q    	r    	s    	t    	<--Classified as
480  	0    	0    	0    	0    	0    	0    	0    	0    	0    	0    	0    	0    	0     1    	0    	0    	0    	1    	0    	 |  482   	a     = alt.atheism
0    	568  	2    	1    	1    	4    	1    	0    	0    	0    	1    	1    	0    	0     1    	0    	0    	0    	0    	0    	 |  580   	b     = comp.graphics
1    	2    	608  	3    	0    	1    	1    	0    	0    	0    	0    	0    	0    	0     0    	0    	0    	0    	0    	0    	 |  616   	c     = comp.os.ms-windows.misc
1    	0    	3    	596  	0    	0    	1    	1    	0    	0    	0    	0    	0    	0     0    	0    	0    	0    	0    	0    	 |  602   	d     = comp.sys.ibm.pc.hardware
0    	1    	2    	2    	565  	0    	1    	0    	0    	0    	0    	0    	1    	0     0    	0    	1    	1    	0    	0    	 |  574   	e     = comp.sys.mac.hardware
0    	1    	1    	0    	0    	610  	1    	0    	0    	0    	0    	0    	0    	0     2    	0    	1    	0    	0    	0    	 |  616   	f     = comp.windows.x
0    	0    	0    	5    	2    	0    	552  	4    	2    	0    	2    	1    	3    	2     0    	0    	1    	0    	0    	0    	 |  574   	g     = misc.forsale
0    	0    	0    	1    	0    	0    	1    	586  	1    	0    	0    	1    	0    	0     0    	0    	0    	0    	0    	0    	 |  590   	h     = rec.autos
0    	0    	0    	0    	0    	0    	0    	0    	601  	0    	0    	0    	0    	0     0    	0    	0    	0    	0    	0    	 |  601   	i     = rec.motorcycles
0    	0    	0    	0    	0    	0    	0    	0    	0    	623  	3    	1    	0    	0     0    	0    	0    	0    	0    	0    	 |  627   	j     = rec.sport.baseball
0    	0    	0    	0    	0    	0    	0    	0    	0    	1    	620  	0    	0    	0     0    	0    	0    	0    	0    	0    	 |  621   	k     = rec.sport.hockey
0    	0    	0    	0    	0    	0    	0    	0    	0    	0    	0    	620  	0    	0     0    	0    	0    	1    	0    	0    	 |  621   	l     = sci.crypt
0    	0    	0    	1    	0    	0    	0    	1    	0    	0    	0    	0    	583  	0     2    	0    	1    	0    	0    	0    	 |  588   	m     = sci.electronics
0    	0    	1    	0    	0    	0    	0    	0    	0    	0    	0    	0    	0    	602   0    	0    	0    	0    	0    	0    	 |  603   	n     = sci.med
0    	0    	0    	0    	0    	0    	0    	0    	0    	0    	0    	0    	0    	1     581  	0    	0    	0    	0    	0    	 |  582   	o     = sci.space
0    	0    	0    	0    	0    	0    	0    	0    	1    	0    	0    	0    	0    	1     0    	599  	0    	0    	0    	0    	 |  601   	p     = soc.religion.christian
0    	0    	0    	0    	0    	0    	0    	0    	0    	2    	0    	0    	0    	0     0    	0    	546  	0    	0    	0    	 |  548   	q     = talk.politics.mideast
0    	0    	1    	0    	0    	0    	0    	0    	0    	0    	0    	2    	0    	0     1    	0    	0    	559  	0    	0    	 |  563   	r     = talk.politics.guns
21   	0    	0    	0    	0    	0    	0    	0    	0    	1    	0    	0    	0    	2     0    	3    	2    	1    	348  	1    	 |  379   	s     = talk.religion.misc
0    	0    	0    	0    	0    	0    	0    	0    	0    	0    	0    	1    	0    	0     1    	0    	1    	4    	0    	466  	 |  473   	t     = talk.politics.misc

=======================================================
Statistics
-------------------------------------------------------
Kappa                                         0.98
Accuracy                                   98.8812%
Reliability                                94.0454%
Reliability (standard deviation)            0.2162

15/03/08 21:10:44 INFO driver.MahoutDriver: Program took 46839 ms (Minutes: 0.78065)
+ echo 'Testing on holdout set'
Testing on holdout set
+ ./bin/mahout testnb -i /tmp/mahout-work-grid/20news-test-vectors -m /tmp/mahout-work-grid/model -l /tmp/mahout-work-grid/labelindex -ow -o /tmp/mahout-work-grid/20news-testing -c
MAHOUT_LOCAL is not set; adding HADOOP_CONF_DIR to classpath.
Warning: $HADOOP_HOME is deprecated.

Running on hadoop, using /home/grid/hadoop-1.2.1/bin/hadoop and HADOOP_CONF_DIR=/home/grid/hadoop-1.2.1/conf
MAHOUT-JOB: /home/grid/mahout-distribution-0.9/mahout-examples-0.9-job.jar
Warning: $HADOOP_HOME is deprecated.

15/03/08 21:10:51 WARN driver.MahoutDriver: No testnb.props found on classpath, will use command-line arguments only
15/03/08 21:10:52 INFO common.AbstractJob: Command line arguments: {--endPhase=[2147483647], --input=[/tmp/mahout-work-grid/20news-test-vectors], --labelIndex=[/tmp/mahout-work-grid/labelindex], --model=[/tmp/mahout-work-grid/model], --output=[/tmp/mahout-work-grid/20news-testing], --overwrite=null, --startPhase=[0], --tempDir=[temp], --testComplementary=null}
15/03/08 21:10:53 INFO common.HadoopUtil: Deleting /tmp/mahout-work-grid/20news-testing
15/03/08 21:10:55 INFO input.FileInputFormat: Total input paths to process : 1
15/03/08 21:10:56 INFO mapred.JobClient: Running job: job_201503081659_0014
15/03/08 21:10:57 INFO mapred.JobClient:  map 0% reduce 0%
15/03/08 21:11:15 INFO mapred.JobClient:  map 28% reduce 0%
15/03/08 21:11:19 INFO mapred.JobClient:  map 54% reduce 0%
15/03/08 21:11:22 INFO mapred.JobClient:  map 81% reduce 0%
15/03/08 21:11:25 INFO mapred.JobClient:  map 100% reduce 0%
15/03/08 21:11:29 INFO mapred.JobClient: Job complete: job_201503081659_0014
15/03/08 21:11:29 INFO mapred.JobClient: Counters: 20
15/03/08 21:11:29 INFO mapred.JobClient:   Job Counters 
15/03/08 21:11:29 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=29556
15/03/08 21:11:29 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/03/08 21:11:29 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/03/08 21:11:29 INFO mapred.JobClient:     Launched map tasks=1
15/03/08 21:11:29 INFO mapred.JobClient:     Data-local map tasks=1
15/03/08 21:11:29 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0
15/03/08 21:11:29 INFO mapred.JobClient:   File Output Format Counters 
15/03/08 21:11:29 INFO mapred.JobClient:     Bytes Written=1394868
15/03/08 21:11:29 INFO mapred.JobClient:   FileSystemCounters
15/03/08 21:11:29 INFO mapred.JobClient:     FILE_BYTES_READ=3676597
15/03/08 21:11:29 INFO mapred.JobClient:     HDFS_BYTES_READ=8434407
15/03/08 21:11:29 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=59446
15/03/08 21:11:29 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=1394868
15/03/08 21:11:29 INFO mapred.JobClient:   File Input Format Counters 
15/03/08 21:11:29 INFO mapred.JobClient:     Bytes Read=8434269
15/03/08 21:11:29 INFO mapred.JobClient:   Map-Reduce Framework
15/03/08 21:11:29 INFO mapred.JobClient:     Map input records=7405
15/03/08 21:11:29 INFO mapred.JobClient:     Physical memory (bytes) snapshot=85610496
15/03/08 21:11:29 INFO mapred.JobClient:     Spilled Records=0
15/03/08 21:11:29 INFO mapred.JobClient:     CPU time spent (ms)=17800
15/03/08 21:11:29 INFO mapred.JobClient:     Total committed heap usage (bytes)=35471360
15/03/08 21:11:29 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=724860928
15/03/08 21:11:29 INFO mapred.JobClient:     Map output records=7405
15/03/08 21:11:29 INFO mapred.JobClient:     SPLIT_RAW_BYTES=138
15/03/08 21:11:31 INFO test.TestNaiveBayesDriver: Complementary Results: 
=======================================================
Summary
-------------------------------------------------------
Correctly Classified Instances          :       6615	   89.3315%
Incorrectly Classified Instances        :        790	   10.6685%
Total Classified Instances              :       7405

=======================================================
Confusion Matrix
-------------------------------------------------------
a    	b    	c    	d    	e    	f    	g    	h    	i    	j    	k    	l    	m    	n     o    	p    	q    	r    	s    	t    	<--Classified as
299  	0    	0    	1    	0    	0    	0    	0    	0    	0    	0    	0    	0    	1     2    	4    	2    	1    	7    	0    	 |  317   	a     = alt.atheism
0    	303  	15   	12   	3    	21   	7    	2    	1    	0    	6    	9    	4    	1     3    	1    	1    	1    	1    	2    	 |  393   	b     = comp.graphics
1    	9    	290  	30   	6    	15   	6    	2    	0    	0    	2    	2    	3    	1     1    	0    	0    	0    	0    	1    	 |  369   	c     = comp.os.ms-windows.misc
1    	9    	18   	303  	7    	6    	12   	1    	2    	0    	3    	0    	9    	4     3    	0    	0    	2    	0    	0    	 |  380   	d     = comp.sys.ibm.pc.hardware
1    	5    	3    	6    	338  	5    	3    	2    	1    	3    	5    	2    	6    	2     6    	0    	0    	1    	0    	0    	 |  389   	e     = comp.sys.mac.hardware
1    	14   	2    	5    	1    	339  	2    	1    	1    	0    	1    	2    	0    	2     1    	0    	0    	0    	0    	0    	 |  372   	f     = comp.windows.x
0    	9    	7    	26   	14   	3    	282  	15   	2    	4    	3    	3    	14   	1     5    	2    	4    	2    	5    	0    	 |  401   	g     = misc.forsale
0    	1    	0    	0    	3    	0    	4    	375  	5    	1    	2    	0    	3    	0     1    	0    	0    	4    	0    	1    	 |  400   	h     = rec.autos
1    	0    	0    	0    	0    	0    	1    	3    	386  	0    	1    	0    	1    	1     1    	0    	0    	0    	0    	0    	 |  395   	i     = rec.motorcycles
0    	0    	1    	0    	0    	0    	0    	1    	0    	346  	12   	0    	2    	0     1    	1    	2    	0    	1    	0    	 |  367   	j     = rec.sport.baseball
0    	1    	0    	0    	0    	0    	0    	0    	0    	0    	376  	0    	0    	0     0    	0    	0    	0    	0    	1    	 |  378   	k     = rec.sport.hockey
0    	0    	2    	0    	0    	2    	0    	1    	0    	0    	0    	360  	0    	2     1    	0    	0    	0    	0    	2    	 |  370   	l     = sci.crypt
0    	3    	2    	9    	4    	4    	6    	5    	7    	2    	2    	1    	337  	2     7    	4    	0    	0    	0    	1    	 |  396   	m     = sci.electronics
0    	0    	0    	1    	0    	1    	2    	2    	2    	0    	3    	2    	1    	365   1    	1    	3    	2    	1    	0    	 |  387   	n     = sci.med
0    	2    	1    	0    	0    	0    	3    	2    	0    	0    	0    	0    	2    	2     389  	0    	1    	1    	1    	1    	 |  405   	o     = sci.space
3    	0    	0    	2    	2    	0    	0    	1    	0    	0    	0    	0    	1    	1     1    	380  	3    	0    	1    	1    	 |  396   	p     = soc.religion.christian
0    	1    	0    	0    	0    	0    	0    	0    	0    	0    	0    	0    	0    	0     0    	1    	390  	0    	0    	0    	 |  392   	q     = talk.politics.mideast
1    	0    	0    	0    	0    	1    	0    	0    	2    	0    	0    	5    	0    	2     0    	1    	2    	324  	3    	6    	 |  347   	r     = talk.politics.guns
26   	0    	0    	0    	3    	0    	0    	1    	0    	0    	2    	0    	0    	2     3    	25   	2    	6    	173  	6    	 |  249   	s     = talk.religion.misc
0    	0    	1    	1    	0    	0    	1    	0    	0    	2    	2    	3    	0    	2     0    	0    	7    	20   	3    	260  	 |  302   	t     = talk.politics.misc

=======================================================
Statistics
-------------------------------------------------------
Kappa                                       0.8602
Accuracy                                   89.3315%
Reliability                                84.7841%
Reliability (standard deviation)            0.2149

15/03/08 21:11:31 INFO driver.MahoutDriver: Program took 40182 ms (Minutes: 0.6697)
[grid@hadoop1 ~]$

你可能感兴趣的:(安装 Mahout)

element实现动态路由+面包屑软件技术NINI vue案例 vue.js 前端
el-breadcrumb是ElementUI组件库中的一个面包屑导航组件，它用于显示当前页面的路径，帮助用户快速理解和导航到应用的各个部分。在Vue.js项目中，如果你已经安装了ElementUI，就可以很方便地使用el-breadcrumb组件。以下是一个基本的使用示例：安装ElementUI（如果你还没有安装的话）:你可以通过npm或yarn来安装ElementUI。bash复制代码npmi
理解Gunicorn：Python WSGI服务器的基石范范0825 ipython linux 运维
理解Gunicorn：PythonWSGI服务器的基石介绍Gunicorn，全称GreenUnicorn，是一个为PythonWSGI（WebServerGatewayInterface）应用设计的高效、轻量级HTTP服务器。作为PythonWeb应用部署的常用工具，Gunicorn以其高性能和易用性著称。本文将介绍Gunicorn的基本概念、安装和配置，帮助初学者快速上手。1.什么是Gunico
Python数据分析与可视化实战指南 William数据分析 python python 数据
在数据驱动的时代，Python因其简洁的语法、强大的库生态系统以及活跃的社区，成为了数据分析与可视化的首选语言。本文将通过一个详细的案例，带领大家学习如何使用Python进行数据分析，并通过可视化来直观呈现分析结果。一、环境准备1.1安装必要库在开始数据分析和可视化之前，我们需要安装一些常用的库。主要包括pandas、numpy、matplotlib和seaborn等。这些库分别用于数据处理、数学
linux sdl windows.h,Windows下的SDL安装奔跑吧linux内核 linux sdl windows.h
首先你要下载并安装SDL开发包。如果装在C盘下，路径为C:\SDL1.2.5如果在WINDOWS下。你可以按以下步骤：1.打开VC++，点击"Tools",Options2,点击directories选项3.选择"Includefiles"增加一个新的路径。"C:\SDL1.2.5\include"4，现在选择"Libaryfiles“增加"C:\SDL1.2.5\lib"现在你可以开始编写你的第
Python教程：一文了解使用Python处理XPath 旦莫 Python进阶 python 开发语言
目录1.环境准备1.1安装lxml1.2验证安装2.XPath基础2.1什么是XPath？2.2XPath语法2.3示例XML文档3.使用lxml解析XML3.1解析XML文档3.2查看解析结果4.XPath查询4.1基本路径查询4.2使用属性查询4.3查询多个节点5.XPath的高级用法5.1使用逻辑运算符5.2使用函数6.实战案例6.1从网页抓取数据6.1.1安装Requests库6.1.2代
PHP环境搭建详细教程好看资源平台前端 php
PHP是一个流行的服务器端脚本语言，广泛用于Web开发。为了使PHP能够在本地或服务器上运行，我们需要搭建一个合适的PHP环境。本教程将结合最新资料，介绍在不同操作系统上搭建PHP开发环境的多种方法，包括Windows、macOS和Linux系统的安装步骤，以及本地和Docker环境的配置。1.PHP环境搭建概述PHP环境的搭建主要分为以下几类：集成开发环境：例如XAMPP、WAMP、MAMP，这
使用LLaVa和Ollama实现多模态RAG示例 llzwxh888 python 人工智能开发语言
本文将详细介绍如何使用LLaVa和Ollama实现多模态RAG（检索增强生成），通过提取图像中的结构化数据、生成图像字幕等功能来展示这一技术的强大之处。安装环境首先，您需要安装以下依赖包：!pipinstallllama-index-multi-modal-llms-ollama!pipinstallllama-index-readers-file!pipinstallunstructured!p
GitHub上克隆项目 bigbig猩猩 github
从GitHub上克隆项目是一个简单且直接的过程，它允许你将远程仓库中的项目复制到你的本地计算机上，以便进行进一步的开发、测试或学习。以下是一个详细的步骤指南，帮助你从GitHub上克隆项目。一、准备工作1.安装Git在克隆GitHub项目之前，你需要在你的计算机上安装Git工具。Git是一个开源的分布式版本控制系统，用于跟踪和管理代码变更。你可以从Git的官方网站（https://git-scm.
Python 实现图片裁剪（附代码） | Python工具剑客阿良_ALiang
前言本文提供将图片按照自定义尺寸进行裁剪的工具方法，一如既往的实用主义。环境依赖ffmpeg环境安装，可以参考我的另一篇文章：windowsffmpeg安装部署_阿良的博客-CSDN博客本文主要使用到的不是ffmpeg，而是ffprobe也在上面这篇文章中的zip包中。ffmpy安装：pipinstallffmpy-ihttps://pypi.douban.com/simple代码不废话了，上代码
第六集如何安装CentOS7.0，3分钟学会centos7安装教程 date分享
从光盘引导系统按回车键继续进入引导程序安装界面，选择语言这里选择简体中文版点击继续选择桌面安装下面给系统分区选择磁盘，点击完成选择基本分区，点击加号swap分区,大小填内存的两倍在选择根分区，使用所有可用的磁盘空间选择文件系统ext4点击完成，点击开始安装设置root密码，点击完成设置普通用户和密码，点击完成整个过程持续八分钟左右根据个人配置不同，时间长短不同好，现在点击重启系统进入重启状态点击本
Python爬虫解析工具之xpath使用详解 eqa11 python 爬虫开发语言
文章目录Python爬虫解析工具之xpath使用详解一、引言二、环境准备1、插件安装2、依赖库安装三、xpath语法详解1、路径表达式2、通配符3、谓语4、常用函数四、xpath在Python代码中的使用1、文档树的创建2、使用xpath表达式3、获取元素内容和属性五、总结Python爬虫解析工具之xpath使用详解一、引言在Python爬虫开发中，数据提取是一个至关重要的环节。xpath作为一门
Linux MariaDB使用OpenSSL安装SSL证书 Meta39 MySQL Oracle MariaDB Linux Windows ssl linux mariadb
进入到证书存放目录，批量删除.pem证书警告：确保已经进入到证书存放目录find.-typef-iname\*.pem-delete查看是否安装OpenSSLopensslversion没有则安装yuminstallopensslopenssl-devel开启SSL编辑/etc/my.cnf文件（没有的话就创建，但是要注意，在/etc/my.cnf.d/server.cnf配置了datadir的，
【六】阿伟开始搭建Kafka学习环境能源恒观中间件学习 kafka spring
阿伟开始搭建Kafka学习环境概述上一篇文章阿伟学习了Kafka的核心概念，并且把市面上流行的消息中间件特性进行了梳理和对比，方便大家在学习过程中进行对比学习，最后梳理了一些Kafka使用中经常遇到的Kafka难题以及解决思路，经过上一篇的学习我相信大家对Kafka有了初步的认识，本篇将继续学习Kafka。一、安装和配置学习一项技术首先要搭建一套服务，而Kafka的运行主要需要部署jdk、zook
openssl+keepalived安装部署 _小亦_ 项目部署 keepalived openssl
文章目录OpenSSL安装下载地址编译安装修改系统配置版本Keepalived安装下载地址安装遇到问题安装完成配置文件keepalived运行检查运行状态查看系统日志修改服务service重新加载systemd检查配置文件语法错误OpenSSL安装下载地址考虑到后面设备可能没法连接到外网，所以采用安装包的方式进行部署，下载地址：https://www.openssl.org/source/old/
1分钟解决 -bash: mvn: command not found，在Centos 7中安装Maven Energet!c 开发语言
1分钟解决-bash:mvn:commandnotfound，在Centos7中安装Maven检查Java环境1下载Maven2解压Maven3配置环境变量4验证安装5常见问题与注意事项6总结检查Java环境Maven依赖Java环境，请确保系统已经安装了Java并配置了环境变量。可以通过以下命令检查：java-version如果未安装，请先安装Java。1下载Maven从官网下载：前往Apach
Python实现简单的机器学习算法 master_chenchengg python python 办公效率 python开发 IT
Python实现简单的机器学习算法开篇：初探机器学习的奇妙之旅搭建环境：一切从安装开始必备工具箱第一步：安装Anaconda和JupyterNotebook小贴士：如何配置Python环境变量算法初体验：从零开始的Python机器学习线性回归：让数据说话数据准备：从哪里找数据编码实战：Python实现线性回归模型评估：如何判断模型好坏逻辑回归：从分类开始理论入门：什么是逻辑回归代码实现：使用skl
CentOS 7官方源停服，配置本机光盘yum源码哝小鱼 linux运维 centos linux 运维
1、挂载系统光盘mkdir/mnt/isomount-oloop/tools/CentOS-7-x86_64-DVD-1810.iso/mnt/isocd/mnt/iso/Packages/rpm-ivh/mnt/iso/Packages/yum-utils-1.1.31-50.el7.noarch.rpm(图形界面安装，默契已安装）如安装yum-utils依赖错误，按提示安装依赖包rpm-ivh
Python入门之Lesson2:Python基础语法小熊同学哦 Python入门课程 python 开发语言算法数据结构青少年编程
目录前言一.介绍1.变量和数据类型2.常见运算符3.输入输出4.条件语句5.循环结构二.练习三.总结前言欢迎来到《Python入门》系列博客的第二课。在上一课中，我们了解了Python的安装及运行环境的配置。在这一课中，我们将深入学习Python的基础语法，这是编写Python代码的根基。通过本节内容的学习，你将掌握变量、数据类型、运算符、输入输出、条件语句等Python编程的基础知识。一.介绍1
react-intl——react国际化使用方案苹果酱0567 面试题汇总与解析 java 开发语言中间件 spring boot 后端
国际化介绍i18n：internationalization国家化简称，首字母+首尾字母间隔的字母个数+尾字母，类似的还有k8s(Kubernetes)React-intl是React中最受欢迎的库。使用步骤安装#usenpmnpminstallreact-intl-D#useyarn项目入口文件配置//index.tsximportReactfrom"react";importReactDOMf
06选课支付模块之基于消息队列发送支付通知消息 echo 云清学成在线 java rabbitmq 消息队列支付通知学成在线
消息队列发送支付通知消息需求分析订单服务作为通用服务，在订单支付成功后需要将支付结果异步通知给其他对接的微服务，微服务收到支付结果根据订单的类型去更新自己的业务数据技术方案使用消息队列进行异步通知需要保证消息的可靠性即生产端将消息成功通知到服务端：消息发送到交换机-->由交换机发送到队列-->消费者监听队列，收到消息进行处理，参考文章02-使用Docker安装RabbitMQ-CSDN博客生产者确
【Bugs】Python：“ModuleNotFoundError: No module named ‘XXX‘” 系'辞工具箱 python bug anaconda
问题描述Python使用库的前提是必须已安装了相应的库，往往利用“命令行指令”实现安装，一般安装解法类似。但，还是具有延伸问题，本博客对此作记录。【1】Nomodulenamed‘seaborn’(1.1):情况1：为Anaconda安装【图1-2】.定位Anaconda路径【图3】.Anaconda路径加入Path>&
遥感影像的切片处理 sand&wich 计算机视觉 python 图像处理
在遥感影像分析中，经常需要将大尺寸的影像切分成小片段，以便于进行详细的分析和处理。这种方法特别适用于机器学习和图像处理任务，如对象检测、图像分类等。以下是如何使用Python和OpenCV库来实现这一过程，同时确保每个影像片段保留正确的地理信息。准备环境首先，确保安装了必要的Python库，包括numpy、opencv-python和xml.etree.ElementTree。这些库将用于图像处理
Vue( ElementUI入门、vue-cli安装) m0_l5z elementui vue.js
一.ElementUI入门目录：1.ElementUI入门1.1ElementUI简介1.2Vue+ElementUI安装1.3开发示例2.搭建nodejs环境2.1nodejs介绍2.2npm是什么2.3nodejs环境搭建2.3.1下载2.3.2解压2.3.3配置环境变量2.3.4配置npm全局模块路径和cache默认安装位置2.3.5修改npm镜像提高下载速度2.3.6验证安装结果3.运行n
2023最详细的Python安装教程（Windows版本）程序员林哥 Python python windows 开发语言
python安装是学习pyhon第一步，很多刚入门小白不清楚如何安装python，今天我来带大家完成python安装与配置，跟着我一步步来，很简单，你肯定能完成。第一部分：python安装（一）准备工作1、下载和安装python(认准官方网站)当然你不想去下载的话也可以分享给你，还有入门学习教程，点击下方卡片跳转进群领取（二）开始安装对于Windows操作系统，可以下载“executableins
Python实现TIFF 文件转换为 PNG 和 JPG 格式 sand&wich python 开发语言
在日常的图像处理工作中，可能会遇到需要将TIFF格式的图像转换为其他格式的情况，例如PNG和JPG。下面，本文将介绍如何使用Python和GDAL库实现这一功能。准备工作在开始之前，请确保已经安装了必要的库：GDAL（GeospatialDataAbstractionLibrary）可以使用以下命令安装GDAL：pipinstallgdal代码实现以下是一个将TIFF文件转换为PNG文件的示例代码
ubuntu安装wordpress lissettecarlr
1安装nginx网上安装方式很多，这就就直接用apt-get了apt-getinstallnginx不用启动啥，然后直接在浏览器里面输入IP:80就能看到nginx的主页了。如果修改了一些配置可以使用下列命令重启一下systemctlrestartnginx.service2安装mysql输入安装前也可以更新一下软件源，在安装过程中将会让你输入数据库的密码。sudoapt-getinstallmy
天猫返利网哪个最好?天猫返利网站有哪些? 优惠券高省
关于哪个返利网站好用，今天汐儿给大家介绍以下十大网站，可以作为参考：1、高省网【高省APP】（邀请码：668666）全网佣金最高。手机应用商店搜索“高省”即可免费下载安装，填写高省邀请码：668666，直升2皇冠，享更高佣金及分红奖励。高省APP全网佣金最高，手机应用商店搜索“高省”即可下载，高省邀请码：668666，此码注册，直升2皇冠，佣金更高！送万元推广大礼包，教你如何1年做到百万团队。其实
计算机毕业设计PHP仓储综合管理系统（源码+程序+VUE+lw+部署） java毕设程序源码王哥 php 课程设计 vue.js
该项目含有源码、文档、程序、数据库、配套开发软件、软件安装教程。欢迎交流项目运行环境配置：phpStudy+Vscode+Mysql5.7+HBuilderX+Navicat11+Vue+Express。项目技术：原生PHP++Vue等等组成，B/S模式+Vscode管理+前后端分离等等。环境需要1.运行环境：最好是小皮phpstudy最新版，我们在这个版本上开发的。其他版本理论上也可以。2.开发
最简单将静态网页挂载到服务器上(不用nginx) 全能全知者服务器 nginx 运维前端 html 笔记
最简单将静态网页挂载到服务器上(不用nginx)如果随便弄个静态网页挂在服务器都要用nignx就太麻烦了，所以直接使用Apache来搭建一些简单前端静态网页会相对方便很多检查Web服务器服务状态：sudosystemctlstatushttpd#ApacheWeb服务器如果发现没有安装web服务器：安装Apache：sudoyuminstallhttpd启动Apache：sudosystemctl
解决Obsidian写笔记中的＜img＞标签无法显示图片的问题全能全知者笔记
Obsidian中写md笔记如果使用标签会显示不出图案，后来才知道因为Obsidian的问题导致只能用绝对路径定位。所以我本人写了一个py插件，将md笔记里的img标签批量替换成Obsidian能够读取的形式。安装FixObsImgDpy:pipinstallFixObsImgDpy安装完成后在需要修复的md文件的父目录下运行命令:FixObsImgDpy就会自动修复父目录以下的全部md文件仓库
mysql主从数据同步林鹤霄 mysql主从数据同步
配置mysql5.5主从服务器(转) 教程开始：一、安装MySQL 说明：在两台MySQL服务器192.168.21.169和192.168.21.168上分别进行如下操作，安装MySQL 5.5.22 二、配置MySQL主服务器（192.168.21.169）mysql -uroot -p &nb
oracle学习笔记 caoyong oracle
1、ORACLE的安装 a>、ORACLE的版本 8i,9i : i是internet 10g,11g : grid (网格) 12c : cloud (云计算) b>、10g不支持win7 &
数据库，SQL零基础入门天子之骄 sql 数据库入门基本术语
数据库，SQL零基础入门做网站肯定离不开数据库，本人之前没怎么具体接触SQL，这几天起早贪黑得各种入门，恶补脑洞。一些具体的知识点，可以让小白不再迷茫的术语，拿来与大家分享。数据库，永久数据的一个或多个大型结构化集合，通常与更新和查询数据的软件相关
pom.xml 一炮送你回车库 pom.xml
1、一级元素dependencies是可以被子项目继承的 2、一级元素dependencyManagement是定义该项目群里jar包版本号的，通常和一级元素properties一起使用，既然有继承，也肯定有一级元素modules来定义子元素 3、父项目里的一级元素<modules> <module>lcas-admin-war</module> <
sql查地区省市县 3213213333332132 sql mysql
-- db_yhm_city SELECT * FROM db_yhm_city WHERE class_parent_id = 1 -- 海南 class_id = 9 港、奥、台 class_id = 33、34、35 SELECT * FROM db_yhm_city WHERE class_parent_id =169 SELECT d1.cla
关于监听器那些让人头疼的事宝剑锋梅花香画图板监听器鼠标监听器
本人初学JAVA，对于界面开发我只能说有点蛋疼，用JAVA来做界面的话确实需要一定的耐心（不使用插件，就算使用插件的话也没好多少）既然Java提供了界面开发，老师又要求做，只能硬着头皮上啦。但是监听器还真是个难懂的地方，我是上了几次课才略微搞懂了些。
JAVA的遍历MAP darkranger map
Java Map遍历方式的选择 1. 阐述　　对于Java中Map的遍历方式，很多文章都推荐使用entrySet，认为其比keySet的效率高很多。理由是：entrySet方法一次拿到所有key和value的集合；而keySet拿到的只是key的集合，针对每个key，都要去Map中额外查找一次value，从而降低了总体效率。那么实际情况如何呢？　　为了解遍历性能的真实差距，包括在遍历ke
POJ 2312 Battle City 优先多列+bfs aijuans 搜索
来源：http://poj.org/problem?id=2312 题意：题目背景就是小时候玩的坦克大战，求从起点到终点最少需要多少步。已知S和R是不能走得，E是空的，可以走，B是砖，只有打掉后才可以通过。思路：很容易看出来这是一道广搜的题目，但是因为走E和走B所需要的时间不一样，因此不能用普通的队列存点。因为对于走B来说，要先打掉砖才能通过，所以我们可以理解为走B需要两步，而走E是指需要1
Hibernate与Jpa的关系，终于弄懂 avords java Hibernate 数据库 jpa
我知道Jpa是一种规范，而Hibernate是它的一种实现。除了Hibernate，还有EclipseLink(曾经的toplink)，OpenJPA等可供选择，所以使用Jpa的一个好处是，可以更换实现而不必改动太多代码。在play中定义Model时，使用的是jpa的annotations，比如javax.persistence.Entity, Table, Column, OneToMany
酸爽的console.log bee1314 console
在前端的开发中，console.log那是开发必备啊，简直直观。通过写小函数，组合大功能。更容易测试。但是在打版本时，就要删除console.log，打完版本进入开发状态又要添加，真不够爽。重复劳动太多。所以可以做些简单地封装，方便开发和上线。 /** * log.js hufeng * The safe wrapper for `console.xxx` functions *
哈佛教授：穷人和过于忙碌的人有一个共同思维特质 bijian1013 时间管理励志人生穷人过于忙碌
一个跨学科团队今年完成了一项对资源稀缺状况下人的思维方式的研究，结论是：穷人和过于忙碌的人有一个共同思维特质，即注意力被稀缺资源过分占据，引起认知和判断力的全面下降。这项研究是心理学、行为经济学和政策研究学者协作的典范。　　这个研究源于穆来纳森对自己拖延症的憎恨。他7岁从印度移民美国，很快就如鱼得水，哈佛毕业
other operate 征客丶 OS osx
一、Mac Finder 设置排序方式，预览栏在显示－》查看显示选项中二、有时预览显示时，卡死在那，有可能是一些临时文件夹被删除了，如：/private/tmp[有待验证] -------------------------------------------------------------------- 若有其他凝问或文中有错误，请及时向我指出，我好及时改正，同时也让我们一
【Scala五】分析Spark源代码总结的Scala语法三 bit1129 scala
1. If语句作为表达式 val properties = if (jobIdToActiveJob.contains(jobId)) { jobIdToActiveJob(stage.jobId).properties } else { // this stage will be assigned to "default" po
ZooKeeper 入门 BlueSkator 中间件 zk
ZooKeeper是一个高可用的分布式数据管理与系统协调框架。基于对Paxos算法的实现，使该框架保证了分布式环境中数据的强一致性，也正是基于这样的特性，使得ZooKeeper解决很多分布式问题。网上对ZK的应用场景也有不少介绍，本文将结合作者身边的项目例子，系统地对ZK的应用场景进行一个分门归类的介绍。值得注意的是，ZK并非天生就是为这些应用场景设计的，都是后来众多开发者根据其框架的特性，利
MySQL取得当前时间的函数是什么格式化日期的函数是什么 BreakingBad mysql Date
取得当前时间用 now() 就行。在数据库中格式化时间用DATE_FORMA T(date, format) . 根据格式串format 格式化日期或日期和时间值date，返回结果串。可用DATE_FORMAT( ) 来格式化DATE 或DATETIME 值，以便得到所希望的格式。根据format字符串格式化date值: %S, %s 两位数字形式的秒（ 00,01,
读《研磨设计模式》-代码笔记-组合模式 bylijinnan java 设计模式
声明：本文只为方便我个人查阅和理解，详细的分析以及源代码请移步原作者的博客http://chjavach.iteye.com/ import java.util.ArrayList; import java.util.List; abstract class Component { public abstract void printStruct(Str
4_JAVA+Oracle面试题(有答案) chenke oracle
基础测试题卷面上不能出现任何的涂写文字，所有的答案要求写在答题纸上，考卷不得带走。选择题 1、 What will happen when you attempt to compile and run the following code? （3） public class Static { static { int x = 5; // 在static内有效 } st
新一代工作流系统设计目标 comsci 工作算法脚本
用户只需要给工作流系统制定若干个需求，流程系统根据需求，并结合事先输入的组织机构和权限结构，调用若干算法，在流程展示版面上面显示出系统自动生成的流程图，然后由用户根据实际情况对该流程图进行微调，直到满意为止，流程在运行过程中，系统和用户可以根据情况对流程进行实时的调整，包括拓扑结构的调整，权限的调整，内置脚本的调整。。。。。在这个设计中，最难的地方是系统根据什么来生成流
oracle 行链接与行迁移 daizj oracle 行迁移
表里的一行对于一个数据块太大的情况有二种(一行在一个数据块里放不下) 第一种情况: INSERT的时候，INSERT时候行的大小就超一个块的大小。Oracle把这行的数据存储在一连串的数据块里(Oracle Stores the data for the row in a chain of data blocks)，这种情况称为行链接(Row Chain)，一般不可避免(除非使用更大的数据
[JShop]开源电子商务系统jshop的系统缓存实现 dinguangx jshop 电子商务
前言 jeeshop中通过SystemManager管理了大量的缓存数据，来提升系统的性能，但这些缓存数据全部都是存放于内存中的，无法满足特定场景的数据更新（如集群环境）。JShop对jeeshop的缓存机制进行了扩展，提供CacheProvider来辅助SystemManager管理这些缓存数据，通过CacheProvider,可以把缓存存放在内存,ehcache,redis，memcache
初三全学年难记忆单词 dcj3sjt126com english word
several 儿子；若干 shelf 架子 knowledge 知识；学问 librarian 图书管理员 abroad 到国外，在国外 surf 冲浪 wave 浪；波浪 twice 两次；两倍 describe 描写；叙述 especially 特别；尤其 attract 吸引 prize 奖品；奖赏 competition 比赛；竞争 event 大事；事件 O
sphinx实践 dcj3sjt126com sphinx
安装参考地址:http://briansnelson.com/How_to_install_Sphinx_on_Centos_Server yum install sphinx 如果失败的话使用下面的方式安装 wget http://sphinxsearch.com/files/sphinx-2.2.9-1.rhel6.x86_64.rpm yum loca
JPA之JPQL（三） frank1234 orm jpa JPQL
1 什么是JPQL JPQL是Java Persistence Query Language的简称，可以看成是JPA中的HQL， JPQL支持各种复杂查询。 2 检索单个对象 @Test public void querySingleObject1() { Query query = em.createQuery("sele
Remove Duplicates from Sorted Array II hcx2013 remove
Follow up for "Remove Duplicates":What if duplicates are allowed at most twice? For example,Given sorted array nums = [1,1,1,2,2,3], Your function should return length
Spring4新特性——Groovy Bean定义DSL jinnianshilongnian spring 4
Spring4新特性——泛型限定式依赖注入 Spring4新特性——核心容器的其他改进 Spring4新特性——Web开发的增强 Spring4新特性——集成Bean Validation 1.1(JSR-349)到SpringMVC Spring4新特性——Groovy Bean定义DSL Spring4新特性——更好的Java泛型操作API Spring4新
CentOS安装Mysql5.5 liuxingguome centos
CentOS下以RPM方式安装MySQL5.5 首先卸载系统自带Mysql： yum remove mysql mysql-server mysql-libs compat-mysql51 rm -rf /var/lib/mysql rm /etc/my.cnf 查看是否还有mysql软件： rpm -qa|grep mysql 去http://dev.mysql.c
第14章工具函数（下） onestopweb 函数
index.html <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> <html xmlns="http://www.w3.org/
POJ 1050 SaraWon 二维数组子矩阵最大和
POJ ACM第1050题的详细描述，请参照 http://acm.pku.edu.cn/JudgeOnline/problem?id=1050 题目意思：给定包含有正负整型的二维数组，找出所有子矩阵的和的最大值。如二维数组 0 -2 -7 0 9 2 -6 2 -4 1 -4 1 -1 8 0 -2 中和最大的子矩阵是 9 2 -4 1 -1 8 且最大和是15
Java8全新打造，英语学习supertool yangshangchuan java superword 闭包 java8 函数式编程
superword是一个Java实现的英文单词分析软件，主要研究英语单词音近形似转化规律、前缀后缀规律、词之间的相似性规律等等。Clean code、Fluent style、Java8 feature: Lambdas, Streams and Functional-style Programming。升学考试、工作求职、充电提高，都少不了英语的身影，英语对我们来说实在太重要