com.github.pmerienne.trident.ml.preprocessing

Interface TextTokenizer

All Known Implementing Classes:

EnglishTokenizer, TwitterTokenizer

public interface TextTokenizer

Method Summary

Methods

Modifier and Type	Method and Description
List<String>	tokenize(String text)

Method Detail

tokenize

List<String> tokenize(String text)