Lucene 分词 TokenStream 取 Token

Lucene 分词  TokenStream 取 Token

TokenStream tokenStream =  
analyzer.tokenStream("content", new StringReader(text));
//TokenStream 遍历  3.5
String s1 = "";
String s2 = "";
while(tokenStream.incrementToken()) {
	//AttributeImpl ta = new AttributeImpl();  
        CharTermAttribute charTermAttribute = tokenStream.getAttribute(CharTermAttribute.class);  
        //TermAttribute ta = ts.getAttribute(TermAttribute.class);  
        s2 = charTermAttribute.toString() + " ";
        System.out.println(s2);
        s1 += s2;  
}
	System.out.println("all = " + s1);