out of memory on long chat input

[jrozentur]

Attempted to summarize a large (66k) file on 2024 Mac mini (24gb) via chat ui

libc++abi: terminating due to uncaught exception of type std::runtime_error: Attempting to allocate 37701212224 bytes which is greater than the maximum allowed buffer size of 12884901888 bytes.

This exited the process. Not sure why, the box has plenty of swap, and about 12gb used by cached files, which is reclaimable. At least some safeguard is needed

[rltakashige]

Noted! This is certainly a feature we will be looking to implement soon.