Shipping Applied Research to Solve Real Problems

We are still in the early days of AI assistants and many things still need to be invented. Our research is driven by real challenges and datasets, and our primary aim is to help the Rasa community build better AI assistants.

Join us at Rasa Developer Summit to learn about the latest applied conversational AI research.

Research topics

These are just some of the topics we're working on. The very curious can directly look at our active branches on GitHub.

Shipped in Rasa 1.3

Dialogue Transformers

What's the best data structure for dialogue memory - a stack? a graph? a flat list? Self-attention gives you great flexibility without a complex memory structure.

Read the paper

Transfer Learning Across Dialogue Tasks

You've built an assistant and it can already help users with a few things. Now you're adding new functionality. How can your assistant re-use the dialogue elements it already knows about in this new context?

Compressing Transformer Language Models

Large-scale language models like BERT, GPT-2, and XLNet show excellent performance on a number of NLU tasks but are very resource intensive. Can we compress these models to get something that's almost as accurate but much faster?

Read about Quantizing BERT
Shipped in Rasa 1.2

Entity Resolution using Knowledge Bases

Combining a dialogue system with a knowledge base allows developers to encode domain knowledge in a scalable way and integrate it with statistical NLU and dialogue models. It also helps your assistant understand messages like the second one or which of those is cheaper? .

Shipped in Rasa NLU 0.12

Supervised Word Embeddings

Pre-trained word embeddings like word2vec and GloVe are a great way to build a simple text classifier. But learning supervised embeddings for your specific task helps you deal with jargon and out-of-vocabulary words. This is now our default intent classification model.

Shipped in Rasa 1.3

Mixing Single and Multi-turn Dialogue

Dialogue elements like small talk and FAQs are single-turn interactions. New retrieval-based models in Rasa can handle all of these simple responses in a single action. This means your dialogue policy becomes much simpler and you need fewer training stories.

Read the blog post
Work in Progress

Conversational Embeddings

Most language models and word embeddings are trained on prose and don't know anything about the rules of conversation. How can we build embeddings that understand the difference between purposeful dialogue and chit-chat, and can detect non-sequiturs?

Talks and Meetups

We regularly host external speakers at our #botsBerlin meetup to talk about their research.

Excited? We're hiring!

Meet the Rasa Research Team


Johannes Mosig

Johannes studied physics and mathematics, covering a wide variety of subjects from particle physics and general relativity to ocean modeling. During his PhD he became interested in machine learning and started a blog about it before joining our team at Rasa as ML Researcher in June 2019. His current research is focused on transfer learning across dialogue tasks.

Daksh Varshneya

Daksh holds a Masters in Data Science from IIIT, Bangalore and has worked on diverse research problems from NLP and Computer Vision in the past. His current research includes representation learning in conversational AI and better interpretable models in deep learning.

Tanja Bergmann

Tanja studied Software Engineering with a focus on NLP. Her master thesis dealt with the question of how to extract relations between entities from German text. She is one of the early contributors of the NLP framework Flair. At Rasa, Tanja currently focuses on natural language understanding, in particular how to leverage the data from knowledge base in a conversation.

Vladimir Vlasov

Vladimir has a PhD in Physics from Potsdam University in nonlinear dynamics. He previously worked in neuroscience, which led him to learn machine learning. His current focus at Rasa is on dialogue research.

Sam Sucik

Sam is currently studying Informatics at the University of Edinburgh.

Alan Nichol

Alan holds a PhD in machine learning from the University of Cambridge and leads the research team at Rasa.

Academic Collaborations

We believe in open collaborations and work closely with a small number of research groups.

Research

Our open source tools are used in research projects and papers at a growing number of leading institutions. In addition, TU Munich published a study benchmarking our NLU system.

Partnerships

We're a partner of the UKRI Centre for Doctoral Training in Natural Language Processing at the University of Edinburgh. We are also sponsors of SigDIAL 2019.

Education

Every year we supervise a few MSc students and take on some interns to work on research. If you are using Rasa in a course, get in touch and we can share materials for use in lectures and group projects.