notice

This is unreleased documentation for Rasa Open Source Documentation Master/Unreleased version.
For the latest released documentation, see the latest version (2.8.x).

Version: Master/Unreleased

rasa.nlu.tokenizers.spacy_tokenizer

SpacyTokenizerGraphComponent Objects

class SpacyTokenizerGraphComponent(TokenizerGraphComponent)

Tokenizer that uses SpaCy.

get_default_config

@staticmethod
def get_default_config() -> Dict[Text, Any]

The component's default config (see parent class for full docstring).

required_packages

@staticmethod
def required_packages() -> List[Text]

Any extra python dependencies required for this component to run.

tokenize

def tokenize(message: Message, attribute: Text) -> List[Token]

Tokenizes the text of the provided attribute of the incoming message.