This is documentation for Rasa Documentation v2.x, which is no longer actively maintained.
For up-to-date documentation, see the latest version (3.x).

Version: 2.x


JiebaTokenizer Objects

class JiebaTokenizer(Tokenizer)

This tokenizer is a wrapper for Jieba (


| __init__(component_config: Dict[Text, Any] = None) -> None

Construct a new intent classifier using the MITIE framework.


| @staticmethod
| load_custom_dictionary(path: Text) -> None

Load all the custom dictionaries stored in the path.

More information about the dictionaries file format can be found in the documentation of jieba.


| @classmethod
| load(cls, meta: Dict[Text, Any], model_dir: Text, model_metadata: Optional["Metadata"] = None, cached_component: Optional[Component] = None, **kwargs: Any, ,) -> "JiebaTokenizer"

Loads trained component (see parent class for full docstring).


| persist(file_name: Text, model_dir: Text) -> Optional[Dict[Text, Any]]

Persist this model into the passed directory.