Aidin

SyntaxError excpetion thrown in response of requestSync method is not rejected properly and crashes

2

If response of the call to requestSync method is not in proper JSON then the response handler throws SyntaxError exception at [JSON.parse](https://github.com/actions-on-google/actions-on-google-nodejs/blob/1c9c56b1e837a7cc54bd1c8058d3ddbe2747863b/src/service/smarthome/smarthome.ts#L301), without rejecting the promise causing the whole node...

I tested both `mlx-swift` and `mlx-lm`, and it seems there is a problem with memory allocation when processing longer prompts. I have used this snippet to run the LLM. ```python...

Unable to allocate memory

3

It seems there is a problem with memory allocation when processing longer prompts, I have used a prompt with around 3500 tokens in `LLMEval` and when processing the prompt, the...