xiaocaichonga

[置顶] Hadoop 实战之分析专利引用数据集（一）

环境：Vmware 8.0 和Ubuntu11.04

Hadoop 实战之分析专利引用数据集（一）---计算专利引用数据并排序

第一步：首先创建一个工程命名为HadoopTest.目录结构如下图:

第二步: 在/home/tanglg1987目录下新建一个start.sh脚本文件，每次启动虚拟机都要删除/tmp目录下的全部文件，重新格式化namenode，代码如下：

sudo rm -rf /tmp/*
rm -rf /home/tanglg1987/hadoop-0.20.2/logs
hadoop namenode -format
hadoop datanode -format
start-all.sh
hadoop fs -mkdir input 
hadoop dfsadmin -safemode leave

第三步：给start.sh增加执行权限并启动hadoop伪分布式集群，代码如下:

chmod 777 /home/tanglg1987/ start.sh
./start.sh

执行过程如下：

12/10/15 23:05:38 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = tanglg1987/127.0.1.1
STARTUP_MSG: args = [-format]
STARTUP_MSG: version = 0.20.2
STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
************************************************************/
12/10/15 23:05:39 INFO namenode.FSNamesystem: fsOwner=tanglg1987,tanglg1987,adm,dialout,cdrom,plugdev,lpadmin,admin,sambashare
12/10/15 23:05:39 INFO namenode.FSNamesystem: supergroup=supergroup
12/10/15 23:05:39 INFO namenode.FSNamesystem: isPermissionEnabled=true
12/10/15 23:05:39 INFO common.Storage: Image file of size 100 saved in 0 seconds.
12/10/15 23:05:39 INFO common.Storage: Storage directory /tmp/hadoop-tanglg1987/dfs/name has been successfully formatted.
12/10/15 23:05:39 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at tanglg1987/127.0.1.1
************************************************************/
12/10/15 23:05:40 INFO datanode.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG: host = tanglg1987/127.0.1.1
STARTUP_MSG: args = [-format]
STARTUP_MSG: version = 0.20.2
STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
************************************************************/
Usage: java DataNode
[-rollback]
12/10/15 23:05:40 INFO datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at tanglg1987/127.0.1.1
************************************************************/
starting namenode, logging to /home/tanglg1987/hadoop-0.20.2/bin/../logs/hadoop-tanglg1987-namenode-tanglg1987.out
localhost: starting datanode, logging to /home/tanglg1987/hadoop-0.20.2/bin/../logs/hadoop-tanglg1987-datanode-tanglg1987.out
localhost: starting secondarynamenode, logging to /home/tanglg1987/hadoop-0.20.2/bin/../logs/hadoop-tanglg1987-secondarynamenode-tanglg1987.out
starting jobtracker, logging to /home/tanglg1987/hadoop-0.20.2/bin/../logs/hadoop-tanglg1987-jobtracker-tanglg1987.out
localhost: starting tasktracker, logging to /home/tanglg1987/hadoop-0.20.2/bin/../logs/hadoop-tanglg1987-tasktracker-tanglg1987.out
Safe mode is OFF

第四步：上传本地文件到hdfs

在专利局http://data.nber.org/patents/网站下载专利数据

http://data.nber.org/patents/apat63_99.zip

hadoop fs -put /home/tanglg1987/cite75_99.txt input

五步：新建一个MyJob.java，代码如下：

package com.baison.action;
import java.io.IOException;
import java.util.Iterator;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.conf.Configured;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapred.FileInputFormat;
import org.apache.hadoop.mapred.FileOutputFormat;
import org.apache.hadoop.mapred.JobClient;
import org.apache.hadoop.mapred.JobConf;
import org.apache.hadoop.mapred.KeyValueTextInputFormat;
import org.apache.hadoop.mapred.MapReduceBase;
import org.apache.hadoop.mapred.Mapper;
import org.apache.hadoop.mapred.OutputCollector;
import org.apache.hadoop.mapred.Reducer;
import org.apache.hadoop.mapred.Reporter;
import org.apache.hadoop.mapred.TextOutputFormat;
import org.apache.hadoop.util.Tool;
import org.apache.hadoop.util.ToolRunner;
public class MyJob extends Configured implements Tool {   
    public static class MapClass extends MapReduceBase
        implements Mapper<Text, Text, Text, Text> {        
        public void map(Text key, Text value,
                        OutputCollector<Text, Text> output,
                        Reporter reporter) throws IOException {                        
            output.collect(value, key);
        }
    }    
    public static class Reduce extends MapReduceBase
        implements Reducer<Text, Text, Text, Text> {
        public void reduce(Text key, Iterator<Text> values,
                           OutputCollector<Text, Text> output,
                           Reporter reporter) throws IOException {                           
            String csv = "";
            while (values.hasNext()) {
                if (csv.length() > 0) csv += ",";
                csv += values.next().toString();
            }
            output.collect(key, new Text(csv));
        }
    }    
    public int run(String[] args) throws Exception {
     for (String string : args) {
   System.out.println(string);
  }
        Configuration conf = getConf();        
        JobConf job = new JobConf(conf, MyJob.class);        
        Path in = new Path(args[0]);
        Path out = new Path(args[1]);
        FileInputFormat.setInputPaths(job, in);
        FileOutputFormat.setOutputPath(job, out);        
        job.setJobName("MyJob");
        job.setMapperClass(MapClass.class);
        job.setReducerClass(Reduce.class);        
        job.setInputFormat(KeyValueTextInputFormat.class);
        job.setOutputFormat(TextOutputFormat.class);
        job.setOutputKeyClass(Text.class);
        job.setOutputValueClass(Text.class);
        job.set("key.value.separator.in.input.line", ",");       
        JobClient.runJob(job);       
        return 0;
    }
    public static void main(String[] args) throws Exception { 
     String [] arg={"hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt","hdfs://localhost:9100/user/tanglg1987/output"};
        int res = ToolRunner.run(new Configuration(), new MyJob(), arg);       
        System.exit(res);
    }
}

第六步：Run On Hadoop，运行过程如下：

hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt
hdfs://localhost:9100/user/tanglg1987/output
12/10/17 21:16:14 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
12/10/17 21:16:14 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
12/10/17 21:16:14 INFO mapred.FileInputFormat: Total input paths to process : 1
12/10/17 21:16:14 INFO mapred.JobClient: Running job: job_local_0001
12/10/17 21:16:14 INFO mapred.FileInputFormat: Total input paths to process : 1
12/10/17 21:16:14 INFO mapred.MapTask: numReduceTasks: 1
12/10/17 21:16:14 INFO mapred.MapTask: io.sort.mb = 100
12/10/17 21:16:14 INFO mapred.MapTask: data buffer = 79691776/99614720
12/10/17 21:16:14 INFO mapred.MapTask: record buffer = 262144/327680
12/10/17 21:16:15 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:15 INFO mapred.MapTask: bufstart = 0; bufend = 4185926; bufvoid = 99614720
12/10/17 21:16:15 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680
12/10/17 21:16:15 INFO mapred.JobClient: map 0% reduce 0%
12/10/17 21:16:17 INFO mapred.MapTask: Finished spill 0
12/10/17 21:16:17 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:17 INFO mapred.MapTask: bufstart = 4185926; bufend = 8372612; bufvoid = 99614720
12/10/17 21:16:17 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680
12/10/17 21:16:17 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:0+67108864
12/10/17 21:16:18 INFO mapred.JobClient: map 13% reduce 0%
12/10/17 21:16:18 INFO mapred.MapTask: Finished spill 1
12/10/17 21:16:18 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:18 INFO mapred.MapTask: bufstart = 8372612; bufend = 12558934; bufvoid = 99614720
12/10/17 21:16:18 INFO mapred.MapTask: kvstart = 196607; kvend = 131070; length = 327680
12/10/17 21:16:19 INFO mapred.MapTask: Finished spill 2
12/10/17 21:16:19 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:19 INFO mapred.MapTask: bufstart = 12558934; bufend = 16745318; bufvoid = 99614720
12/10/17 21:16:19 INFO mapred.MapTask: kvstart = 131070; kvend = 65533; length = 327680
12/10/17 21:16:20 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:0+67108864
12/10/17 21:16:20 INFO mapred.MapTask: Finished spill 3
12/10/17 21:16:20 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:20 INFO mapred.MapTask: bufstart = 16745318; bufend = 20931889; bufvoid = 99614720
12/10/17 21:16:20 INFO mapred.MapTask: kvstart = 65533; kvend = 327677; length = 327680
12/10/17 21:16:21 INFO mapred.JobClient: map 26% reduce 0%
12/10/17 21:16:21 INFO mapred.MapTask: Finished spill 4
12/10/17 21:16:22 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:22 INFO mapred.MapTask: bufstart = 20931889; bufend = 25118734; bufvoid = 99614720
12/10/17 21:16:22 INFO mapred.MapTask: kvstart = 327677; kvend = 262140; length = 327680
12/10/17 21:16:23 INFO mapred.MapTask: Finished spill 5
12/10/17 21:16:23 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:23 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:0+67108864
12/10/17 21:16:23 INFO mapred.MapTask: bufstart = 25118734; bufend = 29305269; bufvoid = 99614720
12/10/17 21:16:23 INFO mapred.MapTask: kvstart = 262140; kvend = 196603; length = 327680
12/10/17 21:16:24 INFO mapred.JobClient: map 43% reduce 0%
12/10/17 21:16:24 INFO mapred.MapTask: Finished spill 6
12/10/17 21:16:24 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:24 INFO mapred.MapTask: bufstart = 29305269; bufend = 33492764; bufvoid = 99614720
12/10/17 21:16:24 INFO mapred.MapTask: kvstart = 196603; kvend = 131066; length = 327680
12/10/17 21:16:25 INFO mapred.MapTask: Finished spill 7
12/10/17 21:16:26 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:26 INFO mapred.MapTask: bufstart = 33492764; bufend = 37680391; bufvoid = 99614720
12/10/17 21:16:26 INFO mapred.MapTask: kvstart = 131066; kvend = 65529; length = 327680
12/10/17 21:16:26 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:0+67108864
12/10/17 21:16:27 INFO mapred.MapTask: Finished spill 8
12/10/17 21:16:27 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:27 INFO mapred.MapTask: bufstart = 37680391; bufend = 41868206; bufvoid = 99614720
12/10/17 21:16:27 INFO mapred.MapTask: kvstart = 65529; kvend = 327673; length = 327680
12/10/17 21:16:27 INFO mapred.JobClient: map 57% reduce 0%
12/10/17 21:16:28 INFO mapred.MapTask: Finished spill 9
12/10/17 21:16:28 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:28 INFO mapred.MapTask: bufstart = 41868206; bufend = 46056257; bufvoid = 99614720
12/10/17 21:16:28 INFO mapred.MapTask: kvstart = 327673; kvend = 262136; length = 327680
12/10/17 21:16:29 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:0+67108864
12/10/17 21:16:29 INFO mapred.MapTask: Finished spill 10
12/10/17 21:16:29 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:29 INFO mapred.MapTask: bufstart = 46056257; bufend = 50244288; bufvoid = 99614720
12/10/17 21:16:29 INFO mapred.MapTask: kvstart = 262136; kvend = 196599; length = 327680
12/10/17 21:16:30 INFO mapred.JobClient: map 70% reduce 0%
12/10/17 21:16:30 INFO mapred.MapTask: Finished spill 11
12/10/17 21:16:31 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:31 INFO mapred.MapTask: bufstart = 50244288; bufend = 54432271; bufvoid = 99614720
12/10/17 21:16:31 INFO mapred.MapTask: kvstart = 196599; kvend = 131062; length = 327680
12/10/17 21:16:32 INFO mapred.MapTask: Finished spill 12
12/10/17 21:16:32 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:0+67108864
12/10/17 21:16:32 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:32 INFO mapred.MapTask: bufstart = 54432271; bufend = 58620635; bufvoid = 99614720
12/10/17 21:16:32 INFO mapred.MapTask: kvstart = 131062; kvend = 65525; length = 327680
12/10/17 21:16:33 INFO mapred.JobClient: map 87% reduce 0%
12/10/17 21:16:33 INFO mapred.MapTask: Finished spill 13
12/10/17 21:16:33 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:33 INFO mapred.MapTask: bufstart = 58620635; bufend = 62808941; bufvoid = 99614720
12/10/17 21:16:33 INFO mapred.MapTask: kvstart = 65525; kvend = 327669; length = 327680
12/10/17 21:16:34 INFO mapred.MapTask: Finished spill 14
12/10/17 21:16:35 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:35 INFO mapred.MapTask: bufstart = 62808941; bufend = 66997060; bufvoid = 99614720
12/10/17 21:16:35 INFO mapred.MapTask: kvstart = 327669; kvend = 262132; length = 327680
12/10/17 21:16:35 INFO mapred.MapTask: Starting flush of map output
12/10/17 21:16:35 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:0+67108864
12/10/17 21:16:36 INFO mapred.JobClient: map 100% reduce 0%
12/10/17 21:16:36 INFO mapred.MapTask: Finished spill 15
12/10/17 21:16:36 INFO mapred.MapTask: Finished spill 16
12/10/17 21:16:36 INFO mapred.Merger: Merging 17 sorted segments
12/10/17 21:16:36 INFO mapred.Merger: Merging 8 intermediate segments out of a total of 17
12/10/17 21:16:38 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:0+67108864
12/10/17 21:16:41 INFO mapred.Merger: Down to the last merge-pass, with 10 segments left of total size: 75511476 bytes
12/10/17 21:16:41 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:0+67108864
12/10/17 21:16:44 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:0+67108864
12/10/17 21:16:47 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:0+67108864
12/10/17 21:16:48 INFO mapred.TaskRunner: Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
12/10/17 21:16:48 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:0+67108864
12/10/17 21:16:48 INFO mapred.TaskRunner: Task 'attempt_local_0001_m_000000_0' done.
12/10/17 21:16:48 INFO mapred.MapTask: numReduceTasks: 1
12/10/17 21:16:48 INFO mapred.MapTask: io.sort.mb = 100
12/10/17 21:16:48 INFO mapred.MapTask: data buffer = 79691776/99614720
12/10/17 21:16:48 INFO mapred.MapTask: record buffer = 262144/327680
12/10/17 21:16:48 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:48 INFO mapred.MapTask: bufstart = 0; bufend = 4188247; bufvoid = 99614720
12/10/17 21:16:48 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680
12/10/17 21:16:49 INFO mapred.MapTask: Finished spill 0
12/10/17 21:16:49 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:49 INFO mapred.MapTask: bufstart = 4188247; bufend = 8376832; bufvoid = 99614720
12/10/17 21:16:49 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680
12/10/17 21:16:50 INFO mapred.MapTask: Finished spill 1
12/10/17 21:16:51 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:51 INFO mapred.MapTask: bufstart = 8376832; bufend = 12565282; bufvoid = 99614720
12/10/17 21:16:51 INFO mapred.MapTask: kvstart = 196607; kvend = 131070; length = 327680
12/10/17 21:16:51 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:67108864+67108864
12/10/17 21:16:51 INFO mapred.JobClient: map 59% reduce 0%
12/10/17 21:16:52 INFO mapred.MapTask: Finished spill 2
12/10/17 21:16:52 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:52 INFO mapred.MapTask: bufstart = 12565282; bufend = 16754414; bufvoid = 99614720
12/10/17 21:16:52 INFO mapred.MapTask: kvstart = 131070; kvend = 65533; length = 327680
12/10/17 21:16:53 INFO mapred.MapTask: Finished spill 3
12/10/17 21:16:54 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:54 INFO mapred.MapTask: bufstart = 16754414; bufend = 20943273; bufvoid = 99614720
12/10/17 21:16:54 INFO mapred.MapTask: kvstart = 65533; kvend = 327677; length = 327680
12/10/17 21:16:54 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:67108864+67108864
12/10/17 21:16:54 INFO mapred.JobClient: map 65% reduce 0%
12/10/17 21:16:55 INFO mapred.MapTask: Finished spill 4
12/10/17 21:16:55 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:55 INFO mapred.MapTask: bufstart = 20943273; bufend = 25132396; bufvoid = 99614720
12/10/17 21:16:55 INFO mapred.MapTask: kvstart = 327677; kvend = 262140; length = 327680
12/10/17 21:16:57 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:67108864+67108864
12/10/17 21:16:57 INFO mapred.JobClient: map 69% reduce 0%
12/10/17 21:16:58 INFO mapred.MapTask: Finished spill 5
12/10/17 21:16:59 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:16:59 INFO mapred.MapTask: bufstart = 25132396; bufend = 29321431; bufvoid = 99614720
12/10/17 21:16:59 INFO mapred.MapTask: kvstart = 262140; kvend = 196603; length = 327680
12/10/17 21:17:00 INFO mapred.MapTask: Finished spill 6
12/10/17 21:17:00 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:67108864+67108864
12/10/17 21:17:00 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:00 INFO mapred.MapTask: bufstart = 29321431; bufend = 33510738; bufvoid = 99614720
12/10/17 21:17:00 INFO mapred.MapTask: kvstart = 196603; kvend = 131066; length = 327680
12/10/17 21:17:00 INFO mapred.JobClient: map 73% reduce 0%
12/10/17 21:17:01 INFO mapred.MapTask: Finished spill 7
12/10/17 21:17:01 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:01 INFO mapred.MapTask: bufstart = 33510738; bufend = 37700146; bufvoid = 99614720
12/10/17 21:17:01 INFO mapred.MapTask: kvstart = 131066; kvend = 65529; length = 327680
12/10/17 21:17:02 INFO mapred.MapTask: Finished spill 8
12/10/17 21:17:02 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:02 INFO mapred.MapTask: bufstart = 37700146; bufend = 41889795; bufvoid = 99614720
12/10/17 21:17:02 INFO mapred.MapTask: kvstart = 65529; kvend = 327673; length = 327680
12/10/17 21:17:03 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:67108864+67108864
12/10/17 21:17:03 INFO mapred.JobClient: map 81% reduce 0%
12/10/17 21:17:03 INFO mapred.MapTask: Finished spill 9
12/10/17 21:17:04 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:04 INFO mapred.MapTask: bufstart = 41889795; bufend = 46079341; bufvoid = 99614720
12/10/17 21:17:04 INFO mapred.MapTask: kvstart = 327673; kvend = 262136; length = 327680
12/10/17 21:17:05 INFO mapred.MapTask: Finished spill 10
12/10/17 21:17:05 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:05 INFO mapred.MapTask: bufstart = 46079341; bufend = 50269061; bufvoid = 99614720
12/10/17 21:17:05 INFO mapred.MapTask: kvstart = 262136; kvend = 196599; length = 327680
12/10/17 21:17:06 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:67108864+67108864
12/10/17 21:17:06 INFO mapred.MapTask: Finished spill 11
12/10/17 21:17:06 INFO mapred.JobClient: map 88% reduce 0%
12/10/17 21:17:06 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:06 INFO mapred.MapTask: bufstart = 50269061; bufend = 54458860; bufvoid = 99614720
12/10/17 21:17:06 INFO mapred.MapTask: kvstart = 196599; kvend = 131062; length = 327680
12/10/17 21:17:07 INFO mapred.MapTask: Finished spill 12
12/10/17 21:17:08 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:08 INFO mapred.MapTask: bufstart = 54458860; bufend = 58648475; bufvoid = 99614720
12/10/17 21:17:08 INFO mapred.MapTask: kvstart = 131062; kvend = 65525; length = 327680
12/10/17 21:17:09 INFO mapred.MapTask: Finished spill 13
12/10/17 21:17:09 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:67108864+67108864
12/10/17 21:17:09 INFO mapred.JobClient: map 95% reduce 0%
12/10/17 21:17:09 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:09 INFO mapred.MapTask: bufstart = 58648475; bufend = 62838648; bufvoid = 99614720
12/10/17 21:17:09 INFO mapred.MapTask: kvstart = 65525; kvend = 327669; length = 327680
12/10/17 21:17:10 INFO mapred.MapTask: Finished spill 14
12/10/17 21:17:10 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:10 INFO mapred.MapTask: bufstart = 62838648; bufend = 67028992; bufvoid = 99614720
12/10/17 21:17:10 INFO mapred.MapTask: kvstart = 327669; kvend = 262132; length = 327680
12/10/17 21:17:10 INFO mapred.MapTask: Starting flush of map output
12/10/17 21:17:11 INFO mapred.MapTask: Finished spill 15
12/10/17 21:17:11 INFO mapred.MapTask: Finished spill 16
12/10/17 21:17:11 INFO mapred.Merger: Merging 17 sorted segments
12/10/17 21:17:11 INFO mapred.Merger: Merging 8 intermediate segments out of a total of 17
12/10/17 21:17:12 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:67108864+67108864
12/10/17 21:17:12 INFO mapred.JobClient: map 100% reduce 0%
12/10/17 21:17:15 INFO mapred.Merger: Down to the last merge-pass, with 10 segments left of total size: 75507463 bytes
12/10/17 21:17:15 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:67108864+67108864
12/10/17 21:17:18 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:67108864+67108864
12/10/17 21:17:21 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:67108864+67108864
12/10/17 21:17:23 INFO mapred.TaskRunner: Task:attempt_local_0001_m_000001_0 is done. And is in the process of commiting
12/10/17 21:17:23 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:67108864+67108864
12/10/17 21:17:23 INFO mapred.TaskRunner: Task 'attempt_local_0001_m_000001_0' done.
12/10/17 21:17:23 INFO mapred.MapTask: numReduceTasks: 1
12/10/17 21:17:23 INFO mapred.MapTask: io.sort.mb = 100
12/10/17 21:17:23 INFO mapred.MapTask: data buffer = 79691776/99614720
12/10/17 21:17:23 INFO mapred.MapTask: record buffer = 262144/327680
12/10/17 21:17:23 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:23 INFO mapred.MapTask: bufstart = 0; bufend = 4190341; bufvoid = 99614720
12/10/17 21:17:23 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680
12/10/17 21:17:24 INFO mapred.MapTask: Finished spill 0
12/10/17 21:17:24 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:24 INFO mapred.MapTask: bufstart = 4190341; bufend = 8380745; bufvoid = 99614720
12/10/17 21:17:24 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680
12/10/17 21:17:25 INFO mapred.MapTask: Finished spill 1
12/10/17 21:17:25 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:25 INFO mapred.MapTask: bufstart = 8380745; bufend = 12571307; bufvoid = 99614720
12/10/17 21:17:25 INFO mapred.MapTask: kvstart = 196607; kvend = 131070; length = 327680
12/10/17 21:17:26 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:134217728+67108864
12/10/17 21:17:26 INFO mapred.MapTask: Finished spill 2
12/10/17 21:17:26 INFO mapred.JobClient: map 73% reduce 0%
12/10/17 21:17:26 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:26 INFO mapred.MapTask: bufstart = 12571307; bufend = 16762033; bufvoid = 99614720
12/10/17 21:17:26 INFO mapred.MapTask: kvstart = 131070; kvend = 65533; length = 327680
12/10/17 21:17:27 INFO mapred.MapTask: Finished spill 3
12/10/17 21:17:27 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:27 INFO mapred.MapTask: bufstart = 16762033; bufend = 20952800; bufvoid = 99614720
12/10/17 21:17:27 INFO mapred.MapTask: kvstart = 65533; kvend = 327677; length = 327680
12/10/17 21:17:28 INFO mapred.MapTask: Finished spill 4
12/10/17 21:17:29 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:134217728+67108864
12/10/17 21:17:29 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:29 INFO mapred.MapTask: bufstart = 20952800; bufend = 25143412; bufvoid = 99614720
12/10/17 21:17:29 INFO mapred.MapTask: kvstart = 327677; kvend = 262140; length = 327680
12/10/17 21:17:29 INFO mapred.JobClient: map 79% reduce 0%
12/10/17 21:17:30 INFO mapred.MapTask: Finished spill 5
12/10/17 21:17:30 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:30 INFO mapred.MapTask: bufstart = 25143412; bufend = 29334124; bufvoid = 99614720
12/10/17 21:17:30 INFO mapred.MapTask: kvstart = 262140; kvend = 196603; length = 327680
12/10/17 21:17:31 INFO mapred.MapTask: Finished spill 6
12/10/17 21:17:31 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:31 INFO mapred.MapTask: bufstart = 29334124; bufend = 33524778; bufvoid = 99614720
12/10/17 21:17:31 INFO mapred.MapTask: kvstart = 196603; kvend = 131066; length = 327680
12/10/17 21:17:32 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:134217728+67108864
12/10/17 21:17:32 INFO mapred.JobClient: map 83% reduce 0%
12/10/17 21:17:32 INFO mapred.MapTask: Finished spill 7
12/10/17 21:17:33 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:33 INFO mapred.MapTask: bufstart = 33524778; bufend = 37715716; bufvoid = 99614720
12/10/17 21:17:33 INFO mapred.MapTask: kvstart = 131066; kvend = 65529; length = 327680
12/10/17 21:17:34 INFO mapred.MapTask: Finished spill 8
12/10/17 21:17:34 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:34 INFO mapred.MapTask: bufstart = 37715716; bufend = 41906544; bufvoid = 99614720
12/10/17 21:17:34 INFO mapred.MapTask: kvstart = 65529; kvend = 327673; length = 327680
12/10/17 21:17:35 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:134217728+67108864
12/10/17 21:17:35 INFO mapred.MapTask: Finished spill 9
12/10/17 21:17:35 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:35 INFO mapred.MapTask: bufstart = 41906544; bufend = 46097751; bufvoid = 99614720
12/10/17 21:17:35 INFO mapred.MapTask: kvstart = 327673; kvend = 262136; length = 327680
12/10/17 21:17:35 INFO mapred.JobClient: map 88% reduce 0%
12/10/17 21:17:36 INFO mapred.MapTask: Finished spill 10
12/10/17 21:17:36 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:36 INFO mapred.MapTask: bufstart = 46097751; bufend = 50288897; bufvoid = 99614720
12/10/17 21:17:36 INFO mapred.MapTask: kvstart = 262136; kvend = 196599; length = 327680
12/10/17 21:17:37 INFO mapred.MapTask: Finished spill 11
12/10/17 21:17:37 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:37 INFO mapred.MapTask: bufstart = 50288897; bufend = 54480358; bufvoid = 99614720
12/10/17 21:17:37 INFO mapred.MapTask: kvstart = 196599; kvend = 131062; length = 327680
12/10/17 21:17:38 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:134217728+67108864
12/10/17 21:17:38 INFO mapred.MapTask: Finished spill 12
12/10/17 21:17:38 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:38 INFO mapred.MapTask: bufstart = 54480358; bufend = 58671642; bufvoid = 99614720
12/10/17 21:17:38 INFO mapred.MapTask: kvstart = 131062; kvend = 65525; length = 327680
12/10/17 21:17:38 INFO mapred.JobClient: map 94% reduce 0%
12/10/17 21:17:39 INFO mapred.MapTask: Finished spill 13
12/10/17 21:17:39 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:39 INFO mapred.MapTask: bufstart = 58671642; bufend = 62863227; bufvoid = 99614720
12/10/17 21:17:39 INFO mapred.MapTask: kvstart = 65525; kvend = 327669; length = 327680
12/10/17 21:17:40 INFO mapred.MapTask: Finished spill 14
12/10/17 21:17:40 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:40 INFO mapred.MapTask: bufstart = 62863227; bufend = 67054803; bufvoid = 99614720
12/10/17 21:17:40 INFO mapred.MapTask: kvstart = 327669; kvend = 262132; length = 327680
12/10/17 21:17:40 INFO mapred.MapTask: Starting flush of map output
12/10/17 21:17:41 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:134217728+67108864
12/10/17 21:17:41 INFO mapred.MapTask: Finished spill 15
12/10/17 21:17:41 INFO mapred.MapTask: Finished spill 16
12/10/17 21:17:41 INFO mapred.Merger: Merging 17 sorted segments
12/10/17 21:17:41 INFO mapred.Merger: Merging 8 intermediate segments out of a total of 17
12/10/17 21:17:41 INFO mapred.JobClient: map 100% reduce 0%
12/10/17 21:17:44 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:134217728+67108864
12/10/17 21:17:44 INFO mapred.Merger: Down to the last merge-pass, with 10 segments left of total size: 75504227 bytes
12/10/17 21:17:47 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:134217728+67108864
12/10/17 21:17:50 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:134217728+67108864
12/10/17 21:17:51 INFO mapred.TaskRunner: Task:attempt_local_0001_m_000002_0 is done. And is in the process of commiting
12/10/17 21:17:51 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:134217728+67108864
12/10/17 21:17:51 INFO mapred.TaskRunner: Task 'attempt_local_0001_m_000002_0' done.
12/10/17 21:17:51 INFO mapred.MapTask: numReduceTasks: 1
12/10/17 21:17:51 INFO mapred.MapTask: io.sort.mb = 100
12/10/17 21:17:51 INFO mapred.MapTask: data buffer = 79691776/99614720
12/10/17 21:17:51 INFO mapred.MapTask: record buffer = 262144/327680
12/10/17 21:17:51 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:51 INFO mapred.MapTask: bufstart = 0; bufend = 4191578; bufvoid = 99614720
12/10/17 21:17:51 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680
12/10/17 21:17:52 INFO mapred.MapTask: Finished spill 0
12/10/17 21:17:53 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:53 INFO mapred.MapTask: bufstart = 4191578; bufend = 8383078; bufvoid = 99614720
12/10/17 21:17:53 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680
12/10/17 21:17:53 INFO mapred.MapTask: Finished spill 1
12/10/17 21:17:54 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:54 INFO mapred.MapTask: bufstart = 8383078; bufend = 12574490; bufvoid = 99614720
12/10/17 21:17:54 INFO mapred.MapTask: kvstart = 196607; kvend = 131070; length = 327680
12/10/17 21:17:54 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:201326592+62748839
12/10/17 21:17:54 INFO mapred.JobClient: map 80% reduce 0%
12/10/17 21:17:54 INFO mapred.MapTask: Finished spill 2
12/10/17 21:17:55 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:55 INFO mapred.MapTask: bufstart = 12574490; bufend = 16766127; bufvoid = 99614720
12/10/17 21:17:55 INFO mapred.MapTask: kvstart = 131070; kvend = 65533; length = 327680
12/10/17 21:17:55 INFO mapred.MapTask: Finished spill 3
12/10/17 21:17:56 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:56 INFO mapred.MapTask: bufstart = 16766127; bufend = 20958217; bufvoid = 99614720
12/10/17 21:17:56 INFO mapred.MapTask: kvstart = 65533; kvend = 327677; length = 327680
12/10/17 21:17:57 INFO mapred.MapTask: Finished spill 4
12/10/17 21:17:57 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:57 INFO mapred.MapTask: bufstart = 20958217; bufend = 25150065; bufvoid = 99614720
12/10/17 21:17:57 INFO mapred.MapTask: kvstart = 327677; kvend = 262140; length = 327680
12/10/17 21:17:57 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:201326592+62748839
12/10/17 21:17:57 INFO mapred.JobClient: map 85% reduce 0%
12/10/17 21:17:58 INFO mapred.MapTask: Finished spill 5
12/10/17 21:17:58 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:58 INFO mapred.MapTask: bufstart = 25150065; bufend = 29341612; bufvoid = 99614720
12/10/17 21:17:58 INFO mapred.MapTask: kvstart = 262140; kvend = 196603; length = 327680
12/10/17 21:17:59 INFO mapred.MapTask: Finished spill 6
12/10/17 21:17:59 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:17:59 INFO mapred.MapTask: bufstart = 29341612; bufend = 33533322; bufvoid = 99614720
12/10/17 21:17:59 INFO mapred.MapTask: kvstart = 196603; kvend = 131066; length = 327680
12/10/17 21:18:00 INFO mapred.MapTask: Finished spill 7
12/10/17 21:18:00 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:18:00 INFO mapred.MapTask: bufstart = 33533322; bufend = 37725421; bufvoid = 99614720
12/10/17 21:18:00 INFO mapred.MapTask: kvstart = 131066; kvend = 65529; length = 327680
12/10/17 21:18:00 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:201326592+62748839
12/10/17 21:18:00 INFO mapred.JobClient: map 90% reduce 0%
12/10/17 21:18:01 INFO mapred.MapTask: Finished spill 8
12/10/17 21:18:01 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:18:01 INFO mapred.MapTask: bufstart = 37725421; bufend = 41917251; bufvoid = 99614720
12/10/17 21:18:01 INFO mapred.MapTask: kvstart = 65529; kvend = 327673; length = 327680
12/10/17 21:18:02 INFO mapred.MapTask: Finished spill 9
12/10/17 21:18:02 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:18:02 INFO mapred.MapTask: bufstart = 41917251; bufend = 46108919; bufvoid = 99614720
12/10/17 21:18:02 INFO mapred.MapTask: kvstart = 327673; kvend = 262136; length = 327680
12/10/17 21:18:03 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:201326592+62748839
12/10/17 21:18:03 INFO mapred.JobClient: map 93% reduce 0%
12/10/17 21:18:03 INFO mapred.MapTask: Finished spill 10
12/10/17 21:18:03 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:18:03 INFO mapred.MapTask: bufstart = 46108919; bufend = 50300567; bufvoid = 99614720
12/10/17 21:18:03 INFO mapred.MapTask: kvstart = 262136; kvend = 196599; length = 327680
12/10/17 21:18:04 INFO mapred.MapTask: Finished spill 11
12/10/17 21:18:05 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:18:05 INFO mapred.MapTask: bufstart = 50300567; bufend = 54492159; bufvoid = 99614720
12/10/17 21:18:05 INFO mapred.MapTask: kvstart = 196599; kvend = 131062; length = 327680
12/10/17 21:18:06 INFO mapred.MapTask: Finished spill 12
12/10/17 21:18:06 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:201326592+62748839
12/10/17 21:18:06 INFO mapred.JobClient: map 97% reduce 0%
12/10/17 21:18:06 INFO mapred.MapTask: Spilling map output: record full = true
12/10/17 21:18:06 INFO mapred.MapTask: bufstart = 54492159; bufend = 58684086; bufvoid = 99614720
12/10/17 21:18:06 INFO mapred.MapTask: kvstart = 131062; kvend = 65525; length = 327680
12/10/17 21:18:07 INFO mapred.MapTask: Finished spill 13
12/10/17 21:18:07 INFO mapred.MapTask: Starting flush of map output
12/10/17 21:18:08 INFO mapred.MapTask: Finished spill 14
12/10/17 21:18:08 INFO mapred.Merger: Merging 15 sorted segments
12/10/17 21:18:08 INFO mapred.Merger: Merging 6 intermediate segments out of a total of 15
12/10/17 21:18:09 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:201326592+62748839
12/10/17 21:18:09 INFO mapred.JobClient: map 100% reduce 0%
12/10/17 21:18:11 INFO mapred.Merger: Down to the last merge-pass, with 10 segments left of total size: 70597223 bytes
12/10/17 21:18:12 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:201326592+62748839
12/10/17 21:18:15 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:201326592+62748839
12/10/17 21:18:17 INFO mapred.TaskRunner: Task:attempt_local_0001_m_000003_0 is done. And is in the process of commiting
12/10/17 21:18:17 INFO mapred.LocalJobRunner: hdfs://localhost:9100/user/tanglg1987/input/cite75_99.txt:201326592+62748839
12/10/17 21:18:17 INFO mapred.TaskRunner: Task 'attempt_local_0001_m_000003_0' done.
12/10/17 21:18:17 INFO mapred.LocalJobRunner:
12/10/17 21:18:17 INFO mapred.Merger: Merging 4 sorted segments
12/10/17 21:18:17 INFO mapred.Merger: Down to the last merge-pass, with 4 segments left of total size: 297120317 bytes
12/10/17 21:18:17 INFO mapred.LocalJobRunner:
12/10/17 21:18:23 INFO mapred.LocalJobRunner: reduce > reduce
12/10/17 21:18:24 INFO mapred.JobClient: map 100% reduce 71%
12/10/17 21:18:26 INFO mapred.LocalJobRunner: reduce > reduce
12/10/17 21:18:27 INFO mapred.JobClient: map 100% reduce 74%
12/10/17 21:18:29 INFO mapred.LocalJobRunner: reduce > reduce
12/10/17 21:18:30 INFO mapred.JobClient: map 100% reduce 77%
12/10/17 21:18:32 INFO mapred.LocalJobRunner: reduce > reduce
12/10/17 21:18:33 INFO mapred.JobClient: map 100% reduce 80%
12/10/17 21:18:35 INFO mapred.LocalJobRunner: reduce > reduce
12/10/17 21:18:36 INFO mapred.JobClient: map 100% reduce 83%
12/10/17 21:18:38 INFO mapred.LocalJobRunner: reduce > reduce
12/10/17 21:18:39 INFO mapred.JobClient: map 100% reduce 86%
12/10/17 21:18:41 INFO mapred.LocalJobRunner: reduce > reduce
12/10/17 21:18:42 INFO mapred.JobClient: map 100% reduce 89%
12/10/17 21:18:44 INFO mapred.LocalJobRunner: reduce > reduce
12/10/17 21:18:45 INFO mapred.JobClient: map 100% reduce 91%
12/10/17 21:18:47 INFO mapred.LocalJobRunner: reduce > reduce
12/10/17 21:18:48 INFO mapred.JobClient: map 100% reduce 94%
12/10/17 21:18:50 INFO mapred.LocalJobRunner: reduce > reduce
12/10/17 21:18:51 INFO mapred.JobClient: map 100% reduce 97%
12/10/17 21:18:53 INFO mapred.TaskRunner: Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
12/10/17 21:18:53 INFO mapred.LocalJobRunner: reduce > reduce
12/10/17 21:18:53 INFO mapred.TaskRunner: Task attempt_local_0001_r_000000_0 is allowed to commit now
12/10/17 21:18:53 INFO mapred.FileOutputCommitter: Saved output of task 'attempt_local_0001_r_000000_0' to hdfs://localhost:9100/user/tanglg1987/output
12/10/17 21:18:53 INFO mapred.LocalJobRunner: reduce > reduce
12/10/17 21:18:53 INFO mapred.TaskRunner: Task 'attempt_local_0001_r_000000_0' done.
12/10/17 21:18:54 INFO mapred.JobClient: map 100% reduce 100%
12/10/17 21:18:54 INFO mapred.JobClient: Job complete: job_local_0001
12/10/17 21:18:54 INFO mapred.JobClient: Counters: 15
12/10/17 21:18:54 INFO mapred.JobClient: FileSystemCounters
12/10/17 21:18:54 INFO mapred.JobClient: FILE_BYTES_READ=1853504370
12/10/17 21:18:54 INFO mapred.JobClient: HDFS_BYTES_READ=930853207
12/10/17 21:18:54 INFO mapred.JobClient: FILE_BYTES_WRITTEN=2603767487
12/10/17 21:18:54 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=158078539
12/10/17 21:18:54 INFO mapred.JobClient: Map-Reduce Framework
12/10/17 21:18:54 INFO mapred.JobClient: Reduce input groups=3258984
12/10/17 21:18:54 INFO mapred.JobClient: Combine output records=0
12/10/17 21:18:54 INFO mapred.JobClient: Map input records=16522439
12/10/17 21:18:54 INFO mapred.JobClient: Reduce shuffle bytes=0
12/10/17 21:18:54 INFO mapred.JobClient: Reduce output records=3258984
12/10/17 21:18:54 INFO mapred.JobClient: Spilled Records=57431615
12/10/17 21:18:54 INFO mapred.JobClient: Map output bytes=264075431
12/10/17 21:18:54 INFO mapred.JobClient: Map input bytes=264075431
12/10/17 21:18:54 INFO mapred.JobClient: Combine input records=0
12/10/17 21:18:54 INFO mapred.JobClient: Map output records=16522439
12/10/17 21:18:54 INFO mapred.JobClient: Reduce input records=16522439
第七步：查看结果集，运行结果如下：

你可能感兴趣的:(linux,String,buffer,input,logging,output)

android系统selinux中添加新属性property 辉色投像
1.定位/android/system/sepolicy/private/property_contexts声明属性开头：persist.charge声明属性类型：u:object_r:system_prop:s0图12.定位到android/system/sepolicy/public/domain.te删除neverallow{domain-init}default_prop:property
LocalDateTime 转 String igotyback java 开发语言
importjava.time.LocalDateTime;importjava.time.format.DateTimeFormatter;publicclassMain{publicstaticvoidmain(String[]args){//获取当前时间LocalDateTimenow=LocalDateTime.now();//定义日期格式化器DateTimeFormatterformat
Linux下QT开发的动态库界面弹出操作（SDL2） 13jjyao QT类 qt 开发语言 sdl2 linux
需求：操作系统为linux，开发框架为qt，做成需带界面的qt动态库，调用方为java等非qt程序难点：调用方为java等非qt程序，也就是说调用方肯定不带QApplication::exec()，缺少了这个，QTimer等事件和QT创建的窗口将不能弹出(包括opencv也是不能弹出)；这与qt调用本身qt库是有本质的区别的思路：1.调用方缺QApplication::exec()，那么我们在接口
每日一题——第九十题互联网打工人no1 C语言程序设计每日一练 c语言
题目：判断子串是否与主串匹配#include#include#include//////判断子串是否在主串中匹配//////主串///子串///boolisSubstring(constchar*str,constchar*substr){intlenstr=strlen(str);//计算主串的长度intlenSub=strlen(substr);//计算子串的长度//遍历主字符串，对每个可能得
每日一题——第八十四题互联网打工人no1 C语言程序设计每日一练 c语言
题目：编写函数1、输入10个职工的姓名和职工号2、按照职工由大到小顺序排列，姓名顺序也随之调整3、要求输入一个职工号，用折半查找法找出该职工的姓名#define_CRT_SECURE_NO_WARNINGS#include#include#defineMAX_EMPLOYEES10typedefstruct{intid;charname[50];}Empolyee;voidinputEmploye
每日一题——第八十二题互联网打工人no1 C语言程序设计每日一练 c语言
题目：将一个控制台输入的字符串中的所有元音字母复制到另一字符串中#include#include#include#include#defineMAX_INPUT1024boolisVowel(charp);intmain(){charinput[MAX_INPUT];charoutput[MAX_INPUT];printf("请输入一串字符串：\n");fgets(input,sizeof(inp
每日一题——第八十三题互联网打工人no1 C语言程序设计每日一练 c语言
题目：将输入的整形数字输出,输出1990，输出"1990"#include#defineMAX_INPUT1024intmain(){intarrr_num[MAX_INPUT];intnum,i=0;printf("请输入一个数字：");scanf_s("%d",&num);while(num!=0){arrr_num[i++]=num%10;num/=10;}printf("\"");for(
C#中使用split分割字符串互联网打工人no1 c#
1、用字符串分隔：usingSystem.Text.RegularExpressions;stringstr="aaajsbbbjsccc";string[]sArray=Regex.Split(str,"js",RegexOptions.IgnoreCase);foreach(stringiinsArray)Response.Write(i.ToString()+"");输出结果：aaabbbc
linux sdl windows.h,Windows下的SDL安装奔跑吧linux内核 linux sdl windows.h
首先你要下载并安装SDL开发包。如果装在C盘下，路径为C:\SDL1.2.5如果在WINDOWS下。你可以按以下步骤：1.打开VC++，点击"Tools",Options2,点击directories选项3.选择"Includefiles"增加一个新的路径。"C:\SDL1.2.5\include"4，现在选择"Libaryfiles“增加"C:\SDL1.2.5\lib"现在你可以开始编写你的第
linux中sdl的使用教程,sdl使用入门 Melissa Corvinus linux中sdl的使用教程
本文通过一个简单示例讲解SDL的基本使用流程。示例中展示一个窗口，窗口里面有个随机颜色快随机移动。当我们鼠标点击关闭按钮时间窗口关闭。基本步骤如下：1.初始化SDL并创建一个窗口。SDL_Init()初始化SDL_CreateWindow()创建窗口2.纹理渲染存储RGB和存储纹理的区别：比如一个从左到右由红色渐变到蓝色的矩形，用存储RGB的话就需要把矩形中每个点的具体颜色值存储下来；而纹理只是一
PHP环境搭建详细教程好看资源平台前端 php
PHP是一个流行的服务器端脚本语言，广泛用于Web开发。为了使PHP能够在本地或服务器上运行，我们需要搭建一个合适的PHP环境。本教程将结合最新资料，介绍在不同操作系统上搭建PHP开发环境的多种方法，包括Windows、macOS和Linux系统的安装步骤，以及本地和Docker环境的配置。1.PHP环境搭建概述PHP环境的搭建主要分为以下几类：集成开发环境：例如XAMPP、WAMP、MAMP，这
使用 FinalShell 进行远程连接（ssh 远程连接 Linux 服务器）编程经验分享开发工具服务器 ssh linux
目录前言基本使用教程新建远程连接连接主机自定义命令路由追踪前言后端开发，必然需要和服务器打交道，部署应用，排查问题，查看运行日志等等。一般服务器都是集中部署在机房中，也有一些直接是云服务器，总而言之，程序员不可能直接和服务器直接操作，一般都是通过ssh连接来登录服务器。刚接触远程连接时，使用的是XSHELL来远程连接服务器，连接上就能够操作远程服务器了，但是仅用XSHELL并没有上传下载文件的功能
python是什么意思中文-在python中%是什么意思编程大乐趣
Python中%有两种：1、数值运算：%代表取模，返回除法的余数。如：>>>7%212、%操作符（字符串格式化，stringformatting），说明如下：%[(name)][flags][width].[precision]typecode(name)为命名flags可以有+，-，''或0。+表示右对齐。-表示左对齐。''为一个空格，表示在正数的左侧填充一个空格，从而与负数对齐。0表示使用0填
libyuv之linux编译 jaronho Linux linux 运维服务器
文章目录一、下载源码二、编译源码三、注意事项1、银河麒麟系统（aarch64）（1）解决armv8-a+dotprod+i8mm指令集支持问题（2）解决armv9-a+sve2指令集支持问题一、下载源码到GitHub网站下载https://github.com/lemenkov/libyuv源码，或者用直接用git克隆到本地，如：gitclonehttps://github.com/lemenko
python os 环境变量 CV矿工 python 开发语言 numpy
环境变量：环境变量是程序和操作系统之间的通信方式。有些字符不宜明文写进代码里，比如数据库密码，个人账户密码，如果写进自己本机的环境变量里，程序用的时候通过os.environ.get（）取出来就行了。os.environ是一个环境变量的字典。环境变量的相关操作importos"""设置/修改环境变量：os.environ[‘环境变量名称’]=‘环境变量值’#其中key和value均为string类
Redis系列：Geo 类型赋能亿级地图位置计算 Ly768768 redis bootstrap 数据库
1前言我们在篇深刻理解高性能Redis的本质的时候就介绍过Redis的几种基本数据结构，它是基于不同业务场景而设计的：动态字符串(REDIS_STRING)：整数(REDIS_ENCODING_INT)、字符串(REDIS_ENCODING_RAW)双端列表(REDIS_ENCODING_LINKEDLIST)压缩列表(REDIS_ENCODING_ZIPLIST)跳跃表(REDIS_ENCODI
ARM驱动学习之5 LEDS驱动 JT灬新一嵌入式 C 底层 arm开发学习单片机
ARM驱动学习之5LEDS驱动知识点：•linuxGPIO申请函数和赋值函数–gpio_request–gpio_set_value•三星平台配置GPIO函数–s3c_gpio_cfgpin•GPIO配置输出模式的宏变量–S3C_GPIO_OUTPUT注意点：DRIVER_NAME和DEVICE_NAME匹配。实现步骤：1.加入需要的头文件：//Linux平台的gpio头文件#include//三
C++ | Leetcode C++题解之第409题最长回文串 Ddddddd_158 经验分享 C++Leetcode 题解
题目：题解：classSolution{public:intlongestPalindrome(strings){unordered_mapcount;intans=0;for(charc:s)++count[c];for(autop:count){intv=p.second;ans+=v/2*2;if(v%2==1andans%2==0)++ans;}returnans;}};
【华为OD技术面试真题精选 - 非技术题】 -HR面，综合面_华为od hr面一个射手座的程序媛程序员华为od 面试职场和发展
最后的话最近很多小伙伴找我要Linux学习资料，于是我翻箱倒柜，整理了一些优质资源，涵盖视频、电子书、PPT等共享给大家！资料预览给大家整理的视频资料：给大家整理的电子书资料：如果本文对你有帮助，欢迎点赞、收藏、转发给朋友，让我有持续创作的动力！网上学习资料一大堆，但如果学到的知识不成体系，遇到问题时只是浅尝辄止，不再深入研究，那么很难做到真正的技术提升。需要这份系统化的资料的朋友，可以点击这里获
简介Shell、zsh、bash zhaosuningsn Shell zsh bash shell linux bash
Shell是Linux和Unix的外壳，类似衣服，负责外界与Linux和Unix内核的交互联系。例如接收终端用户及各种应用程序的命令，把接收的命令翻译成内核能理解的语言，传递给内核，并把内核处理接收的命令的结果返回给外界，即Shell是外界和内核沟通的桥梁或大门。Linux和Unix提供了多种Shell，其中有种bash，当然还有其他好多种。Mac电脑中不但有bash，还有一个zsh，预装的，据说
Linux MariaDB使用OpenSSL安装SSL证书 Meta39 MySQL Oracle MariaDB Linux Windows ssl linux mariadb
进入到证书存放目录，批量删除.pem证书警告：确保已经进入到证书存放目录find.-typef-iname\*.pem-delete查看是否安装OpenSSLopensslversion没有则安装yuminstallopensslopenssl-devel开启SSL编辑/etc/my.cnf文件（没有的话就创建，但是要注意，在/etc/my.cnf.d/server.cnf配置了datadir的，
【从浅识到熟知Linux】Linux发展史 Jammingpro 从浅学到熟知Linux linux 运维服务器
归属专栏：从浅学到熟知Linux个人主页：Jammingpro每日努力一点点，技术变化看得见文章前言：本篇文章记录Linux发展的历史，因在介绍Linux过程中涉及的其他操作系统及人物，本文对相关内容也有所介绍。文章目录Unix发展史Linux发展史开源Linux官网企业应用情况发行版本在学习Linux前，我们可能都会问Linux从哪里来？它是如何发展的。但在介绍Linux之前，需要先介绍一下Un
linux 发展史种树的猴子内核 java 操作系统 linux 大数据
linux发展史说明此前对linux认识模糊一知半解，近期通过学习将自己对于linux的发展总结一下方便大家日后的学习。那Linux是目前一款非常火热的开源操作系统，可是linux是什么时候出现的，又是因为什么样的原因被开发出来的呢。以下将对linux的发展历程进行详细的讲解。目录一、Linux发展背景二、UINIX的诞生三、UNIX的重要分支-BSD的诞生四、Minix的诞生五、GNU与Free
Linux sh命令 fengyehongWorld Linux linux
目录一.基本语法二.选项2.1-c字符串中读取内容，并执行2.1.1基本用法2.1.2获取当前目录下失效的超链接2.2-x每个命令执行之前，将其打印出来2.3结合Here文档使用一.基本语法⏹Linux和Unix系统中用于执行shell脚本或运行命令的命令。sh[选项][脚本文件][参数...]⏹选项-c：从字符串中读取内容，并执行。-x：在每个命令执行之前，将其打印出来。-s：从标准流中读取内容
推荐算法_隐语义-梯度下降 _feivirus_ 算法机器学习和数学推荐算法机器学习隐语义
importnumpyasnp1.模型实现"""inputrate_matrix:M行N列的评分矩阵，值为P*Q.P:初始化用户特征矩阵M*K.Q:初始化物品特征矩阵K*N.latent_feature_cnt:隐特征的向量个数max_iteration:最大迭代次数alpha:步长lamda:正则化系数output分解之后的P和Q"""defLFM_grad_desc(rate_matrix,l
Linux vi常用命令 fengyehongWorld Linux linux
参考资料viコマンド（vimコマンド）リファレンス目录一.保存系命令二.删除系命令三.移动系命令四.复制粘贴系命令一.保存系命令⏹保存并退出:wq⏹强制保存并退出:wq!⏹退出(文件未编辑):q⏹强制退出(忽略已编辑内容):q!⏹另存为:w新文件名二.删除系命令⏹删除当前行dd⏹清空整个文档gg：移动到文档顶部dG：删除到最后一行ggdG三.移动系命令⏹移动到文档顶部gg⏹移动到文档底部#方式1G
用Python实现简单的猜数字游戏程序媛了了 python 游戏 java
猜数字游戏代码：importrandomdefpythonit():a=random.randint(1,100)n=int(input("输入你猜想的数字："))whilen!=a:ifn>a:print("很遗憾，猜大了")n=int(input("请再次输入你猜想的数字："))elifna::如果玩家猜的数字n大于随机数字a，则输出"很遗憾，猜大了"，并提示玩家再次输入。elifn
2024.9.6 Python，华为笔试题总结，字符串格式化，字符串操作，广度优先搜索解决公司组织绩效互评问题，无向图 RaidenQ python 华为 leetcode 算法力扣广度优先无向图
1.字符串格式化name="Alice"age=30formatted_string="Name:{},Age:{}".format(name,age)print(formatted_string)或者name="Alice"age=30formatted_string=f"Name:{name},Age:{age}"print(formatted_string)2.网络健康检查第一行有两个整数m
Linux查看服务器日志 TPBoreas 运维 linux 运维
一、tail这个是我最常用的一种查看方式用法如下：tail-n10test.log查询日志尾部最后10行的日志;tail-n+10test.log查询10行之后的所有日志;tail-fn10test.log循环实时查看最后1000行记录(最常用的)一般还会配合着grep用，(实时抓包)例如:tail-fn1000test.log|grep'关键字'（动态抓包）tail-fn1000test.log
python怎么将png转为tif_png转tif weixin_39977276
发国外的文章要求图片是tif，cmyk色彩空间的。大小尺寸还有要求。比如网上大神多，找到了一段代码，感谢！https://www.jianshu.com/p/ec2af4311f56https://github.com/KevinZc007/image2Tifimportjava.awt.image.BufferedImage;importjava.io.File;importjava.io.Fi
ztree设置禁用节点 3213213333332132 JavaScript ztree json setDisabledNode Ajax
ztree设置禁用节点的时候注意，当使用ajax后台请求数据,必须要设置为同步获取数据，否者会获取不到节点对象，导致设置禁用没有效果。 $(function(){ showTree(); setDisabledNode(); });
JVM patch by Taobao bookjovi java HotSpot
在网上无意中看到淘宝提交的hotspot patch，共四个，有意思，记录一下。 7050685：jsdbproc64.sh has a typo in the package name 7058036：FieldsAllocationStyle=2 does not work in 32-bit VM 7060619：C1 should respect inline and
将session存储到数据库中 dcj3sjt126com sql PHP session
CREATE TABLE sessions ( id CHAR(32) NOT NULL, data TEXT, last_accessed TIMESTAMP NOT NULL, PRIMARY KEY (id) ); <?php /** * Created by PhpStorm. * User: michaeldu * Date
Vector 171815164 vector
public Vector<CartProduct> delCart(Vector<CartProduct> cart, String id) { for (int i = 0; i < cart.size(); i++) { if (cart.get(i).getId().equals(id)) { cart.remove(i);
各连接池配置参数比较 g21121 连接池
排版真心费劲，大家凑合看下吧，见谅~ Druid DBCP C3P0 Proxool 数据库用户名称 Username Username User 数据库密码 Password Password Password 驱动名
[简单]mybatis insert语句添加动态字段 53873039oycg mybatis
mysql数据库,id自增,配置如下： <insert id="saveTestTb" useGeneratedKeys="true" keyProperty="id" parameterType=&
struts2拦截器配置云端月影 struts2拦截器
struts2拦截器interceptor的三种配置方法方法1. 普通配置法 <struts> <package name="struts2" extends="struts-default"> &
IE中页面不居中，火狐谷歌等正常 aijuans IE中页面不居中
问题是首页在火狐、谷歌、所有IE中正常显示，列表页的页面在火狐谷歌中正常，在IE6、7、8中都不中，觉得可能那个地方设置的让IE系列都不认识，仔细查看后发现，列表页中没写HTML模板部分没有添加DTD定义，就是<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3
String,int,Integer,char 几个类型常见转换 antonyup_2006 html sql .net
如何将字串 String 转换成整数 int? int i = Integer.valueOf(my_str).intValue(); int i=Integer.parseInt(str); 如何将字串 String 转换成Integer ? Integer integer=Integer.valueOf(str); 如何将整数 int 转换成字串 String ? 1.
PL/SQL的游标类型百合不是茶显示游标(静态游标)隐式游标游标的更新和删除 %rowtype ref游标(动态游标)
游标是oracle中的一个结果集,用于存放查询的结果; PL/SQL中游标的声明; 1,声明游标 2,打开游标(默认是关闭的); 3,提取数据 4,关闭游标注意的要点:游标必须声明在declare中,使用open打开游标,fetch取游标中的数据,close关闭游标隐式游标:主要是对DML数据的操作隐
JUnit4中@AfterClass @BeforeClass @after @before的区别对比 bijian1013 JUnit4 单元测试
一.基础知识 JUnit4使用Java5中的注解（annotation），以下是JUnit4常用的几个annotation： @Before：初始化方法对于每一个测试方法都要执行一次（注意与BeforeClass区别，后者是对于所有方法执行一次）@After：释放资源对于每一个测试方法都要执行一次（注意与AfterClass区别，后者是对于所有方法执行一次
精通Oracle10编程SQL(12)开发包 bijian1013 oracle 数据库 plsql
/* *开发包 *包用于逻辑组合相关的PL/SQL类型（例如TABLE类型和RECORD类型）、PL/SQL项（例如游标和游标变量）和PL/SQL子程序（例如过程和函数） */ --包用于逻辑组合相关的PL/SQL类型、项和子程序，它由包规范和包体两部分组成 --建立包规范：包规范实际是包与应用程序之间的接口，它用于定义包的公用组件，包括常量、变量、游标、过程和函数等 --在包规
【EhCache二】ehcache.xml配置详解 bit1129 ehcache.xml
在ehcache官网上找了多次，终于找到ehcache.xml配置元素和属性的含义说明文档了，这个文档包含在ehcache.xml的注释中！ ehcache.xml ： http://ehcache.org/ehcache.xml ehcache.xsd ： http://ehcache.org/ehcache.xsd ehcache配置文件的根元素是ehcahe ehcac
java.lang.ClassNotFoundException: org.springframework.web.context.ContextLoaderL 白糖_ java eclipse spring tomcat Web
今天学习spring+cxf的时候遇到一个问题：在web.xml中配置了spring的上下文监听器： <listener> <listener-class>org.springframework.web.context.ContextLoaderListener</listener-class> </listener> 随后启动
angular.element boyitech AngularJS AngularJS API angular.element
angular.element 描述: 包裹着一部分DOM element或者是HTML字符串，把它作为一个jQuery元素来处理。（类似于jQuery的选择器啦）如果jQuery被引入了，则angular.element就可以看作是jQuery选择器，选择的对象可以使用jQuery的函数；如果jQuery不可用，angular.e
java-给定两个已排序序列，找出共同的元素。 bylijinnan java
import java.util.ArrayList; import java.util.Arrays; import java.util.List; public class CommonItemInTwoSortedArray { /** * 题目：给定两个已排序序列，找出共同的元素。 * 1.定义两个指针分别指向序列的开始。 * 如果指向的两个元素
sftp 异常，有遇到的吗？求解 Chen.H java jcraft auth jsch jschexception
com.jcraft.jsch.JSchException: Auth cancel at com.jcraft.jsch.Session.connect(Session.java:460) at com.jcraft.jsch.Session.connect(Session.java:154) at cn.vivame.util.ftp.SftpServerAccess.connec
[生物智能与人工智能]神经元中的电化学结构代表什么? comsci 人工智能
我这里做一个大胆的猜想,生物神经网络中的神经元中包含着一些化学和类似电路的结构,这些结构通常用来扮演类似我们在拓扑分析系统中的节点嵌入方程一样,使得我们的神经网络产生智能判断的能力,而这些嵌入到节点中的方程同时也扮演着"经验"的角色.... 我们可以尝试一下...在某些神经
通过LAC和CID获取经纬度信息 dai_lm lac cid
方法1：用浏览器打开http://www.minigps.net/cellsearch.html，然后输入lac和cid信息(mcc和mnc可以填0)，如果数据正确就可以获得相应的经纬度方法2：发送HTTP请求到http://www.open-electronics.org/celltrack/cell.php?hex=0&lac=<lac>&cid=&
JAVA的困难分析 datamachine java
前段时间转了一篇SQL的文章（http://datamachine.iteye.com/blog/1971896），文章不复杂，但思想深刻，就顺便思考了一下java的不足，当砖头丢出来，希望引点和田玉。 -----------------------------------------------------------------------------------------
小学5年级英语单词背诵第二课 dcj3sjt126com english word
money 钱 paper 纸 speak 讲，说 tell 告诉 remember 记得，想起 knock 敲，击，打 question 问题 number 数字，号码 learn 学会，学习 street 街道 carry 搬运，携带 send 发送，邮寄，发射 must 必须 light 灯，光线，轻的 front
linux下面没有tree命令 dcj3sjt126com linux
centos p安装 yum -y install tree mac os安装 brew install tree 首先来看tree的用法 tree 中文解释：tree 功能说明：以树状图列出目录的内容。语　　法：tree [-aACdDfFgilnNpqstux][-I <范本样式>][-P <范本样式
Map迭代方式，Map迭代，Map循环蕃薯耀 Map循环 Map迭代 Map迭代方式
Map迭代方式，Map迭代，Map循环 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 蕃薯耀 2015年
Spring Cache注解+Redis hanqunfeng spring
Spring3.1 Cache注解依赖jar包：  <dependency> <groupId>org.springframework.data</groupId> <artifactId>spring-data-redis</artifactId>
Guava中针对集合的 filter和过滤功能 jackyrong filter
在guava库中，自带了过滤器(filter)的功能，可以用来对collection 进行过滤，先看例子： @Test public void whenFilterWithIterables_thenFiltered() { List<String> names = Lists.newArrayList("John"
学习编程那点事 lampcy 编程 android PHP html5
一年前的夏天，我还在纠结要不要改行，要不要去学php？能学到真本事吗？改行能成功吗？太多的问题，我终于不顾一切，下定决心，辞去了工作，来到传说中的帝都。老师给的乘车方式还算有效，很顺利的就到了学校，赶巧了，正好学校搬到了新校区。先安顿了下来，过了个轻松的周末，第一次到帝都，逛逛吧！接下来的周一，是我噩梦的开始，学习内容对我这个零基础的人来说，除了勉强完成老师布置的作业外，我已经没有时间和精力去
架构师之流处理---------bytebuffer的mark,limit和flip nannan408 ByteBuffer
1.前言。如题，limit其实就是可以读取的字节长度的意思，flip是清空的意思，mark是标记的意思。 2.例子. 例子代码: String str = "helloWorld"; ByteBuffer buff = ByteBuffer.wrap(str.getBytes()); Sy
org.apache.el.parser.ParseException: Encountered " ":" ": "" at line 1, column 1 Everyday都不同 $转义 el表达式
最近在做Highcharts的过程中，在写js时，出现了以下异常：严重: Servlet.service() for servlet jsp threw exception org.apache.el.parser.ParseException: Encountered " ":" ": "" at line 1,
用Java实现发送邮件到163 tntxia java实现
/* 在java版经常看到有人问如何用javamail发送邮件？如何接收邮件？如何访问多个文件夹等。问题零散，而历史的回复早已经淹没在问题的海洋之中。本人之前所做过一个java项目，其中包含有WebMail功能，当初为用java实现而对javamail摸索了一段时间，总算有点收获。看到论坛中的经常有此方面的问题，因此把我的一些经验帖出来，希望对大家有些帮助。此篇仅介绍用
探索实体类存在的真正意义 java小叶檀 POJO
一. 实体类简述实体类其实就是俗称的POJO,这种类一般不实现特殊框架下的接口，在程序中仅作为数据容器用来持久化存储数据用的 POJO（Plain Old Java Objects）简单的Java对象它的一般格式就是 public class A{ private String id; public Str