notice

This is documentation for Rasa Open Source Documentation v2.0.x, which is no longer actively maintained.
For up-to-date documentation, see the latest version (2.1.x).

Version: 2.0.x

rasa.nlu.tokenizers.jieba_tokenizer

JiebaTokenizer Objects

class JiebaTokenizer(Tokenizer)

__init__

| __init__(component_config: Dict[Text, Any] = None) -> None

Construct a new intent classifier using the MITIE framework.

load_custom_dictionary

| @staticmethod
| load_custom_dictionary(path: Text) -> None

Load all the custom dictionaries stored in the path.

More information about the dictionaries file format can be found in the documentation of jieba. https://github.com/fxsjy/jieba#load-dictionary

persist

| persist(file_name: Text, model_dir: Text) -> Optional[Dict[Text, Any]]

Persist this model into the passed directory.