Package org.apache.lucene.analysis.it
Class ItalianAnalyzer
- java.lang.Object
-
- org.apache.lucene.analysis.Analyzer
-
- org.apache.lucene.analysis.StopwordAnalyzerBase
-
- org.apache.lucene.analysis.it.ItalianAnalyzer
-
- All Implemented Interfaces:
java.io.Closeable
,java.lang.AutoCloseable
public final class ItalianAnalyzer extends StopwordAnalyzerBase
Analyzer
for Italian.- Since:
- 3.1
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description private static class
ItalianAnalyzer.DefaultSetHolder
Atomically loads the DEFAULT_STOP_SET in a lazy fashion once the outer class accesses the static final set the first time.;-
Nested classes/interfaces inherited from class org.apache.lucene.analysis.Analyzer
Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents
-
-
Field Summary
Fields Modifier and Type Field Description private static CharArraySet
DEFAULT_ARTICLES
static java.lang.String
DEFAULT_STOPWORD_FILE
File containing default Italian stopwords.private CharArraySet
stemExclusionSet
-
Fields inherited from class org.apache.lucene.analysis.StopwordAnalyzerBase
stopwords
-
Fields inherited from class org.apache.lucene.analysis.Analyzer
GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY
-
-
Constructor Summary
Constructors Constructor Description ItalianAnalyzer()
Builds an analyzer with the default stop words:DEFAULT_STOPWORD_FILE
.ItalianAnalyzer(CharArraySet stopwords)
Builds an analyzer with the given stop words.ItalianAnalyzer(CharArraySet stopwords, CharArraySet stemExclusionSet)
Builds an analyzer with the given stop words.
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description protected Analyzer.TokenStreamComponents
createComponents(java.lang.String fieldName)
Creates aAnalyzer.TokenStreamComponents
which tokenizes all the text in the providedReader
.static CharArraySet
getDefaultStopSet()
Returns an unmodifiable instance of the default stop words set.protected TokenStream
normalize(java.lang.String fieldName, TokenStream in)
Wrap the givenTokenStream
in order to apply normalization filters.-
Methods inherited from class org.apache.lucene.analysis.StopwordAnalyzerBase
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet
-
Methods inherited from class org.apache.lucene.analysis.Analyzer
attributeFactory, close, getOffsetGap, getPositionIncrementGap, getReuseStrategy, getVersion, initReader, initReaderForNormalization, normalize, setVersion, tokenStream, tokenStream
-
-
-
-
Field Detail
-
stemExclusionSet
private final CharArraySet stemExclusionSet
-
DEFAULT_STOPWORD_FILE
public static final java.lang.String DEFAULT_STOPWORD_FILE
File containing default Italian stopwords.- See Also:
- Constant Field Values
-
DEFAULT_ARTICLES
private static final CharArraySet DEFAULT_ARTICLES
-
-
Constructor Detail
-
ItalianAnalyzer
public ItalianAnalyzer()
Builds an analyzer with the default stop words:DEFAULT_STOPWORD_FILE
.
-
ItalianAnalyzer
public ItalianAnalyzer(CharArraySet stopwords)
Builds an analyzer with the given stop words.- Parameters:
stopwords
- a stopword set
-
ItalianAnalyzer
public ItalianAnalyzer(CharArraySet stopwords, CharArraySet stemExclusionSet)
Builds an analyzer with the given stop words. If a non-empty stem exclusion set is provided this analyzer will add aSetKeywordMarkerFilter
before stemming.- Parameters:
stopwords
- a stopword setstemExclusionSet
- a set of terms not to be stemmed
-
-
Method Detail
-
getDefaultStopSet
public static CharArraySet getDefaultStopSet()
Returns an unmodifiable instance of the default stop words set.- Returns:
- default stop words set.
-
createComponents
protected Analyzer.TokenStreamComponents createComponents(java.lang.String fieldName)
Creates aAnalyzer.TokenStreamComponents
which tokenizes all the text in the providedReader
.- Specified by:
createComponents
in classAnalyzer
- Parameters:
fieldName
- the name of the fields content passed to theAnalyzer.TokenStreamComponents
sink as a reader- Returns:
- A
Analyzer.TokenStreamComponents
built from anStandardTokenizer
filtered withElisionFilter
,LowerCaseFilter
,StopFilter
,SetKeywordMarkerFilter
if a stem exclusion set is provided andItalianLightStemFilter
.
-
normalize
protected TokenStream normalize(java.lang.String fieldName, TokenStream in)
Description copied from class:Analyzer
Wrap the givenTokenStream
in order to apply normalization filters. The default implementation returns theTokenStream
as-is. This is used byAnalyzer.normalize(String, String)
.
-
-