NeMo-Guardrails icon indicating copy to clipboard operation
NeMo-Guardrails copied to clipboard
verified publisher icon NVIDIA

The message "yes" is blocked by the input rail.

Open drazvan opened this issue 1 year ago • 2 comments

The current implementation can block any message that contains "yes" if the LLM decides to repeat the message and to respond with something like "No, the user message 'Yes' should not be blocked". The self check logic needs to be improved to:

  1. Generate a smaller number of token
  2. If the response starts with yes or no, it should ignore the rest.

drazvan avatar Jun 07 '24 13:06 drazvan

Hi @drazvan, I would like to contribute on this issue. Do you think this could potentially be a good first issue to tackle? Do you have further relevant information for me to be able to look into this? If this is not a good first issue, can you point me to what you believe is something I can contribute on is?

ajanitshimanga avatar Jun 11 '24 04:06 ajanitshimanga

Hi @ajanitshimanga! I think we have this one already in progress. Can you try to pick up on this one instead: https://github.com/NVIDIA/NeMo-Guardrails/issues/277? Thanks!

drazvan avatar Jun 14 '24 19:06 drazvan

Fixed by #674

Pouyanpi avatar Aug 20 '24 10:08 Pouyanpi