本文整理了Java中org.apache.lucene.document.Field.tokenStream()方法的一些代码示例，展示了Field.tokenStream()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。Field.tokenStream()方法的具体详情如下：
包路径：org.apache.lucene.document.Field
类名称：Field
方法名：tokenStream

Field.tokenStream介绍

[英]Pre-analyzed tokenStream for indexed fields; this is separate from fieldsData because you are allowed to have both; eg maybe field has a String value but you customize how it's tokenized
[中]索引字段的预分析令牌流；这与fieldsData是分开的，因为您可以同时拥有这两种数据；例如，字段可能有一个字符串值，但您可以自定义它的标记化方式

代码示例

代码示例来源：origin: com.strapdata.elasticsearch/elasticsearch

@Override
  public TokenStream tokenStream(Analyzer analyzer, TokenStream previous) {
    TokenStream ts = ctx.wrapTokenStream(super.tokenStream(analyzer, previous));
    return new CompletionTokenStream(ts, payload, toFiniteStrings);
  }
}

代码示例来源：origin: harbby/presto-connectors

@Override
  public TokenStream tokenStream(Analyzer analyzer, TokenStream previous) {
    TokenStream ts = ctx.wrapTokenStream(super.tokenStream(analyzer, previous));
    return new CompletionTokenStream(ts, payload, toFiniteStrings);
  }
}

代码示例来源：origin: harbby/presto-connectors

@Override
public TokenStream tokenStream(Analyzer analyzer, TokenStream reuse) {
 CompletionTokenStream completionStream = wrapTokenStream(super.tokenStream(analyzer, reuse));
 completionStream.setPayload(buildSuggestPayload());
 return completionStream;
}

代码示例来源：origin: harbby/presto-connectors

@Override
public TokenStream tokenStream(Analyzer analyzer, TokenStream reuse) {
 if (fieldType().indexOptions() == IndexOptions.NONE) {
  // not indexed
  return null;
 }
 // if numericType is set
 if (type.numericType() != null) {
  // return numeric encoding
  return super.tokenStream(analyzer, reuse);
 }
 if (reuse instanceof GeoPointTokenStream == false) {
  reuse = new GeoPointTokenStream();
 }
 final GeoPointTokenStream gpts = (GeoPointTokenStream)reuse;
 gpts.setGeoCode(((Number) fieldsData).longValue());
 return reuse;
}