functions-framework-cpp icon indicating copy to clipboard operation
functions-framework-cpp copied to clipboard

Consider a different concurrency model for the framework

Open coryan opened this issue 5 years ago • 1 comments

The framework currently uses "thread-per-connection" concurrency model. This was simple to implement, but may not be what we want as it places no practical limits on the number of threads and connections.

We may want to consider something like a fixed thread-pool. I am partial to the Leader/Followers Pattern (obviously), but a single thread for I/O and a thread-pool to handle each request could be made to work too.

Only once we have decided on the threading model does it make sense to talk about controlling the thread pool sizes as discussed in #25

coryan avatar Nov 25 '20 13:11 coryan

This does not seem like a GA blocker.

coryan avatar Feb 22 '21 12:02 coryan