Version: 2.0.x

Telemetry Event Reference

Event descriptions of telemetry data we report in order to improve our products.

Telemetry events are only reported if telemetry is enabled. A detailed explanation on the reasoning behind collecting optional telemetry events can be found in our telemetry documentation.

Model Training

Training Started

backend A training of a Rasa machine learning model got started. The event provides information on aggregated training data statistics. Event properties:
  • language (string): Language model is trained with, e.g. 'en'.
  • training_id (string): Generated unique identifier for this training.
  • type (string): Type of model trained, either 'nlu', 'core' or 'rasa'.
  • pipeline (undefined): List of the pipeline configurations used for training.
  • policies (array): List of the policy configurations used for training.
  • num_intent_examples (integer): Number of NLU examples.
  • num_entity_examples (integer): Number of entity examples.
  • num_actions (integer): Number of actions defined in the domain.
  • num_templates (integer): Number of templates defined in the domain.
  • num_slots (integer): Number of slots defined in the domain.
  • num_forms (integer): Number of forms defined in the domain.
  • num_intents (integer): Number of intents defined in the domain.
  • num_entities (integer): Number of entities defined in the domain.
  • num_story_steps (integer): Number of story steps available.
  • num_lookup_tables (integer): Number of different lookup tables.
  • num_synonyms (integer): Total number of entity synonyms defined.
  • num_regexes (integer): Total number of regexes defined.

Training Completed

backend The training of a Rasa machine learning model finished. The event provides information about the resulting model. Event properties:
  • training_id (string): Generated unique identifier for this training. Can be used to join with 'Training Started'.
  • type (string): Type of model trained, either 'nlu', 'core' or 'rasa'.
  • runtime (integer): The time in seconds it took to train the model.

Model Testing

Model Core Tested

backend Triggered when a Core model is getting tested. Event properties:
  • project (string,null): Fingerprint of the project the tested model got trained in.
  • num_story_steps (integer): Number of story steps used for testing
  • end_to_end (boolean): Indicates if tests are running in end-to-end mode, testing message handling and dialogue handling at the same time

Model NLU Tested

backend Triggered when an NLU model is getting tested. Event properties:
  • num_intent_examples (integer): Number of NLU examples.
  • num_entity_examples (integer): Number of entity examples.
  • num_lookup_tables (integer): Number of different lookup tables.
  • num_synonyms (integer): Total number of entity synonyms defined.
  • num_regexes (integer): Total number of regexes defined.

Model Serving

Interactive Learning Started

backend Triggered when an interactive learning session got started. Event properties:
  • skip_visualization (boolean): Whether the visualization of stories should be shown during the interactive learning session
  • save_in_e2e (boolean): Whether the data should be stored in end-to-end format

Server Started

backend Triggered when a Rasa Open Source server gets started. Event properties:
  • input_channels (array): Names of the used input channels
  • api_enabled (boolean): Indicator if the API is enabled or if only the input channel is running
  • number_of_workers (integer): Amount of Sanic workers started as part of the server
  • endpoints_nlg (string,null): Type of the used NLG endpoint
  • endpoints_nlu (string,null): Type of the used NLU endpoint
  • endpoints_action_server (string,null): Type of the used action server
  • endpoints_model_server (string,null): Type of the used model server
  • endpoints_tracker_store (string,null): Type of the used tracker store
  • endpoints_lock_store (string,null): Type of the used lock store
  • endpoints_event_broker (string,null): Type of the used event broker
  • project (string,null): Hash of the deployed model the server is started with

Shell Started

backend Triggered when a shell session is started to talk to a trained bot. Event properties:
  • type (string): Type of the model, either 'nlu', 'core' or 'rasa'.

Rasa X Local Started

backend Triggered when a Rasa X is started in local mode.

Data Handling

Training Data Split

backend Triggered when training data gets split. Event properties:
  • fraction (number): Percentage of the data which goes into training data (the rest goes into the test set).
  • type (string): Type of data, either 'nlu', 'core' or 'rasa'.

Training Data Validated

backend Triggered when training data gets validated. Event properties:
  • validation_success (boolean): whether the validation was successful

Training Data Converted

backend Triggered when training data gets converted. Event properties:
  • output_format (string): target format of the converter
  • type (string): Type of data, either 'nlu', 'core', 'config' or 'nlg'.

Tracker Exported

backend Triggered when conversations get exported from a tracker store through an event broker. Event properties:
  • event_broker (string): Name of the used event broker
  • tracker_store (string): Name of the used tracker store
  • number_of_exported_events (integer): Number of events exported through the event broker

Story Visualization Started

backend Triggered when stories are getting visualized.

Miscellaneous

Telemetry Disabled

backend Triggered when telemetry reporting gets disabled. Last event sent before disabling telemetry. This event is not sent, if the user never enabled telemetry reporting before deactivating it.

Project Created

backend Triggered when a project is created using rasa init. Event properties:
  • init_directory (string): Hash of the directory path the project is created in