How to improve the confidence score of the intent in Rasa NLU?

I was working on Rasa NLU for intent classification, in link how shall I improve the confidence score for a given intent.

I have tried to give more training data but still the confidence score isn't increasing. Can anyone please let me know which parameters hyperparameters I can tune in order to get good confidence score.
I did tried to all possible combinations provided in this link but still there was hardly any improvement.

I did checked the suggestion provided over here, but I am looking for granular tuning of the model such that it can perform better.

Thanks.

Edit 1: Please provide a valid reason for down-voting the question.

2 Answers
2

You can use tensorflow_embedding which gives confidence score near to .9, rather than using spacy_sklearn which provides neat to .3

Depending whether spaCy provides a good language model for your language, you should either use the spaCy pipeline (as it comes with pretrained models) or the tensorflow_embedding pipeline which works with any language but requires more training examples.

tensorflow_embedding

I think that your problems might be caused by overlapping training examples. An example to clarify:

## intent:ask_bot_name
- Tell me your name
- What is your name
- name please

## intent:ask_location_name
- Tell me the name
- What's the name
- name please


So I would suggest to go through your training data and have a look whether different intents have the same or very very similar examples.

Thanks for contributing an answer to Stack Overflow!

But avoid …

To learn more, see our tips on writing great answers.

Some of your past answers have not been well-received, and you're in danger of being blocked from answering.

Please pay close attention to the following guidance:

But avoid …

To learn more, see our tips on writing great answers.

Required, but never shown

Required, but never shown

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.