Interface | Description |
---|---|
Tokenizer |
A tokenizer divides an input string into tokens.
|
Class | Description |
---|---|
AbstractTokenizer |
Convenience tokenizer.
|
QGram | Deprecated
Use
Tokenizers.qGram(int) instead |
QGramExtended | Deprecated |
Tokenizers |
Utilities for tokenizers.
|
Whitespace | Deprecated
use
Tokenizers.whitespace() instead |
Copyright © 2014–2018. All rights reserved.