Local LLM Deployment Optimization

[void-b583x2-NULL]

Description of changes:

• More arguments controlling the params for locally deployed LLM (Currently Mistral/Mixtral)
• Corrected prompt for Mistral (to avoid truncations)
• API optimization

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.