Installation Guide (Helm)
Installation
Once you have all of the requirements satisfied, follow the steps below to deploy the Studio Helm chart inside your Kubernetes cluster.
Step 1: Pull the official Studio helm chart
You can run the below-mentioned command to pull the latest version chart from Rasa's Google Artifact Registry.
helm pull oci://europe-west3-docker.pkg.dev/rasa-releases/helm-charts/studio
This will download the chart file (for example studio-1.0.3.tgz
) to your machine. Extract this file to see the chart templates and values.yaml
file.
Step 2: Create a value file:
A value file contains the configuration options and parameters for the Helm chart. You can customize these options based on your requirements. A sample values.yaml
file is available in the Studio Helm Chart. The file can be seen if you extract the .tgz
chart file you downloaded from the Google Artifact Registry. Follow these steps to create your value file:
- Make a copy of
values.yaml
file which can be found inside extracted chart directory. Let us call itmy-values.yaml
. This file will serve as your custom value file. - Open
my-values.yaml
in a text editor and modify the configuration options according to your needs. Ensure that you review and update values related to the way your Kubernetes cluster is set up. The chart's readme file will provide you with all the keys that are available with their default values. - Save and close the
my-values.yaml
file.
tip
Please make sure to keep the replicaCount
of the pods to 1
except for the model training consumer
and the model running consumer
If you would like to run multiple parallel assistant training in Studio make sure to increase replicaCount of model training consumer and model running consumer pods. For example, if you plan to work with 4 assistants in Studio with parallel training sessions, it’s recommended to set model running consumer
replicaCount to number of assistants + 1
(minimum) or number of assistants * 2
(recommended) and model training consumer
to number of assistants
i.e 4
in this case.
tip
Studio backend container has a DOCKER_IMAGE_TAG
environment variable. You need to pass the complete docker repository URL of a Rasa Pro image (version 3.7.0 and above).
tip
For PostgreSQL database you must percentage-encode special characters in any part of your connection URL - including passwords. For example, p@$$w0rd
becomes p%40%24%24w0rd
.
Step 3: Creating Kubernetes secrets:
To store sensitive values mentioned in the above section it is recommended to create Kubernetes secrets. To create them
- Make a copy of the
secrets.yaml
file which can be found inside extracted chart directory. Let us call itmy-secrets.yaml
. - Create base64 encoded values of the secrets and update the yaml file with them. You can run
echo -n "my-secret-key" | base64
to quickly createbase64
encoded values of your secrets. - Once all the secrets are updated run
kubectl apply -f my-secrets.yaml -n <namespace>
. This creates the Kubernetes secret in the namespace where you plan to deploy Studio. - These secrets are then referenced and passed onto the pods inside the cluster when Studio is deployed with
my-values.yaml
file created in the previous step.
SECRET KEY | SECRET VALUE |
---|---|
DATABASE_URL | Database URL of the Studio backend database. This should be of the format postgresql://${DB_USER}:${DB_PASS}@${DB_HOST}:${DB_PORT}/${DB_NAME}?schema=public |
DATABASE_PASSWORD | Database password for the Studio databases |
KAFKA_SASL_PASSWORD | Kakfa password if you use the SASL mechanism |
KEYCLOAK_ADMIN_PASSWORD | Password to the admin user interface of Keycloak (Studio’s user management system). You should use this credential to login to http://<external-ip-or-hostname>/auth |
KEYCLOAK_API_PASSWORD | Password to access Keycloak API. Studio uses this internally to communicate with Keycloak |
RASA_PRO_LICENSE_SECRET_KEY | Rasa Pro license key |
OPENAI_API_KEY_SECRET_KEY | OpenAI API key |
TRAINING_STORAGE_SIGNED_URL_SERVICE_ACCOUNT | Service Account email id for accessing Google cloud storage bucket for Studio’s model-service. This is only needed if you plan to deploy on GCP |
GCP_CREDS | Contents of the JSON key file of your Google service account to access Google cloud storage bucket for Studio’s model-service. This is only needed if you plan to deploy on GCP |
AWS_ACCESS_KEY_ID | AWS Access Key ID to access S3 bucket for Studio’s model-service. Only needed for AWS deployment |
AWS_SECRET_ACCESS_KEY | AWS Access Secret Key to access S3 bucket for Studio’s model-service. Only needed for AWS deployment |
Step 4: Deploy Rasa Studio using Helm:
With the Helm chart and value file prepared, you are ready to deploy Rasa Studio in your Kubernetes cluster. Run the following command:
<release-name>
: Choose a name for your Rasa Studio release, for example,rasa-studio
.<path-to-chart-folder>
: Provide the path to the extracted folder of thetgz
file you obtained by downloading the chart from the Google Artifactory registry.<path-to-value-file>
: Specify the path to your custom value file (my-values.yaml
).<namespace>
Kubernetes namespace you want to deploy to.
Example command:
Helm will begin the deployment process, creating the necessary resources and configurations based on the provided values.
Step 5: Monitor deployment and access Rasa Studio:
Once the deployment is complete, you can monitor the deployment status by running:
Ensure that all pods are running and ready before accessing Rasa Studio.
You can access Rasa Studio by visiting the URL https://<external-ip-or-hostname>
in your web browser. You can now proceed to user management and license activation.
You can access Rasa Studio User Management UI (Keycloak) by visiting the URL https://<external-ip-or-hostname>/auth
in your web browser. The login credentials for the Keycloak Administration Console
is the value that you provided for the KEYCLOAK_ADMIN
and KEYCLOAK_ADMIN_PASSWORD
environment variables in the values
file.
You can then select the KEYCLOAK_REALM
(rasa-studio
) and add users to Studio.
Please note that additional configurations and customizations can be made by modifying the value file (my-values.yaml
) and upgrading the deployment using the helm upgrade
command.
For further information on advanced configuration options and maintenance tasks, refer to the Rasa Studio Helm charts documentation (README.md
in the downloaded Helm chart and inline comments in values.yaml
file) and the official Helm documentation.