This page contains detailed instructions for installing Rasa X in a scalable cluster environment using OpenShift or Kubernetes (K8S).
Rasa X is available as a Helm Chart for a cluster setup. If you are not using Helm in your cluster, you can still use the following instructions to generate the Kubernetes or OpenShift object configurations via the Helm command-line interface, and install those configurations manually.
Note: Rasa X is intended to be installed on a server and not to a personal/local machine. Installing on a server is recommended because Rasa X is designed to stay up continuously, and not to be frequently stopped or restarted.
To install the Rasa X Helm chart, you need an existing Kubernetes cluster or OpenShift cluster. Setting up a Kubernetes / OpenShift cluster can be tedious, hence we recommend to get a managed cluster from a cloud provider like Google Cloud, DigitalOcean, Microsoft Azure, or Amazon EKS.
The requirements of the single pods can vary, especially those of the
rasa-worker pods, dependent on the model size and what
pipeline is used and the number of users. We recommend providing at least the
We recommend a size of 10 GiB for the Rasa X volume claim and at least 30 GiB for the database volume claim.
Please check that you installed the Kubernetes or OpenShift command line interface (CLI). You can check this using the following command:
kubectl version --short --client# The output should be similar to this# Client Version: v1.16.3
Make sure that the Kubernetes / OpenShift CLI is correctly connected to your cluster. You can do so by using the following commands:
kubectl version --short# The output should be similar to this# Client Version: v1.16.3# Server Version: v1.14.8-gke.12
If you get an error when executing the command, you are not connected to your cluster. To get the command to connect to the cluster please consult your cluster’s admin or the documentation of your cloud provider.
If you are using K3s for an embedded Kubernetes installation, please make sure that you exported the path to the Kubernetes config:export KUBECONFIG=/etc/rancher/k3s/k3s.yaml
Please make sure you have the Helm CLI installed. To check this, run:helm version --short# The output should be similar to this# v3.0.0+ge29ce2a
If this command leads to an error, please install the Helm CLI.
In case you are using a version
<3of Helm, please update to Helm version
The web interface aims to support browsers that meet the following criteria:
0.2% market share
not Internet Explorer
not Opera Mini
If you’re installing Rasa Enterprise, please follow the Rasa Enterprise instructions where given. If a step does not have separate instructions, the step applies to both Rasa X and Rasa Enterprise.
1. Create Namespace
We recommend installing Rasa X in a separate namespace to avoid interfering with existing cluster deployments. To create a new namespace run the following command:
2. Create Values File
Prepare an empty file called
values.yml which will include all your custom
configuration for the installation with Helm.
3. Configure Credentials
To configure the credentials, copy the section below into the
file and replace each
<safe credential> marker with a different alphanumeric
string. Please use safe credentials to avoid data breaches.
- Rasa X
- Rasa Enterprise
4. Specify Rasa X and Rasa Open Source Versions
We recommend using the latest Rasa X version (0.38.2) and the latest Rasa Open Source version (2.4.0).
5. Configure Rasa X Image
- Rasa X
- Rasa Enterprise
6. Optional: Configure Custom Action Server
See these instructions to configure a custom action server.
If you are following the Using Helm to Generate Object Configurations guide, stop here and continue with the latter.
7. Deploy Rasa X
Run the following commands:
OpenShift only: If the deployment fails and
oc get events returns
1001 is not an allowed group spec.containers.securityContext.securityContext.runAsUser,
re-run the installation command with an added
--set securityContext.fsGroup=null flag.
Then wait until the deployment is ready. If you want to check on its status, the following command will block until the Rasa X deployment is ready:
Alternatively you can also monitor the pods directly. Note that the deployment process can involve containers restarting until everything is ready (e.g. if the database container is not ready yet).
8. Access Rasa X
By default the Rasa X deployment is exposed via the
nginx service. You can get
the IP address using this command:
You can then access the deployment on
- Rasa X
- Rasa Enterprise
Note: Depending on the used cluster / cloud provider this might not work. Please refer
to the cloud provider’s documentation / administrator what the recommended way
for exposing the
nginx service is. We are also happy to help you with any
issues in the Rasa Forum.
This section describes how to retrieve secrets from your running deployment. You have the option to retrieve the following secrets:
|description||default secret name|
|PostgreSQL database password|
|Redis lock store and cache password|
|RabbitMQ event broker password|
Run the following command, replacing
<secret name> with one of the values in the
<your namespace> and
<your release name> with your namespace and
the name of your release:
If you’re not sure what namespace or release name your deployment runs under, you can use the following commands to find out. To list the available namespaces, run:
And to list the releases under a particular namespace namespace, run:
This section describes how to get logs from the running containers.
Get the name of the pod which you want to get the logs of.
kubectl --namespace <your namespace> \get pods# The output should be similar to this:# NAME READY STATUS RESTARTS AGE# rasa-app-58d476497-ktkqn 1/1 Running 0 45m# rasa-duckling-7696b7f474-km6dx 1/1 Running 0 45m# rasa-event-service-7657b6b489-96drn 1/1 Running 1 45m# rasa-nginx-64b6b464f6-p9bmb 1/1 Running 0 45m# rasa-postgresql-0 1/1 Running 0 45m# rasa-rabbit-0 1/1 Running 0 45m# rasa-rasa-production-c86fbf7f7-q9pp5 1/1 Running 0 45m# rasa-rasa-worker-5d49485976-6z2kj 1/1 Running 0 45m# rasa-rasa-x-5788cddbb7-5zf86 1/1 Running 0 45m# rasa-redis-master-0 1/1 Running 0 45m
rasa-rasa-x-5788cddbb7-5zf86is for example the name of the Rasa X container.
To get the logs of the container run:
kubectl --namespace <your namespace> \logs <name of the pod>
Using Helm to Generate Object Configurations
If you don’t want or cannot use Helm to install Rasa X in your cluster, you can still use Helm to generate the Kubernetes / OpenShift resource files.
Follow the installation instructions until the deployment part.
Run the following command to generate the Kubernetes / OpenShift resource files and write them in a file
helm repo add rasa-x https://rasahq.github.io/rasa-x-helmhelm repo updatehelm template \--namespace <your namespace> \--values values.yml \<your release name> \rasa-x/rasa-x > rasa-x-deployment.yml
- Using Docker
You can then deploy these manually by running:
kubectl --namespace <your namespace> \create -f rasa-x-deployment.yml