glide
glide copied to clipboard
🔧 Use ObjectPools for chat request/response schemas
Use ObjectPools to optimize memory allocation of
- chat request/response schema allocations
- chat stream chunk schema allocations
@roma-glushko Could you assign this one to me? I've got a PR up for the first part, and will start working on streaming.