public class TokenizerOperation extends AbstractDelegatingOperation
Modifier and Type | Field and Description |
---|---|
static String |
DELIMITERS
Parameter list that determines the delimiters this
operation will use to concatanate tokens.
|
static String |
PHRASE_OPERATIONS
Parameter that determines the operations this operation
will perform on the phrases.
|
static String |
TOKEN_OPERATIONS
Parameter that determines the operations this operation
will perform on the tokens.
|
Constructor and Description |
---|
TokenizerOperation() |
TokenizerOperation(String[] delimiters) |
Modifier and Type | Method and Description |
---|---|
boolean |
execute(POS pos,
String lemma,
BaseFormSet forms)
Execute the operation.
|
addDelegate, create
public static final String TOKEN_OPERATIONS
public static final String PHRASE_OPERATIONS
public static final String DELIMITERS
public TokenizerOperation()
public TokenizerOperation(String[] delimiters)
public boolean execute(POS pos, String lemma, BaseFormSet forms) throws JWNLException
Operation
forms
- BaseFormSet to which all discovered base forms should
be added.JWNLException