rellm
rellm copied to clipboard
Parallel prediction for multiple prompts
Hello,
Thank you for a very interesting solution!
Do you have any ideas how rellm can be used to make controllable generation for multiple prompts?