robinson96
robinson96
Hey Robert, Chai requires lambdas to capture managed arrays by value – it’s the resulting copy constructor call that ensures data is allocated (if necessary) on the device and moved...
That sounds like a good idea to me. -Peter From: Robert Carson ***@***.***> Sent: Wednesday, July 28, 2021 11:32 AM To: LLNL/CHAI ***@***.***> Cc: Robinson, Peter ***@***.***>; Mention ***@***.***> Subject:...
One other concern - by choosing not to do a realloc on the CPU side of things, you're forcing a copy to always happen, while most realloc implementations will avoid...
I think actually having those symbols defined as extern instances of ExecutionSpace that defaulted to a reasonable alternative choice would be a good alternative. Having those be simple non-const externs...
Also affected by #7051 at my institution, would love to see this merged in!
Any updates on this?
I'm also getting the above error with 0.66.0-alpha.3 Very similar config with custom provider and urls, but running gpt-5.1