kafka-connect-lambda icon indicating copy to clipboard operation
kafka-connect-lambda copied to clipboard
verified publisher icon Nordstrom

High number of threads

Open dinegri opened this issue 2 years ago • 0 comments

Hi,

I have running a big Kafka Connect cluster using Sink Lambda connector, we have 450 connectors and 2700 tasks and 12 workers (22GB reserved to xmx) and we are facing issues of "OutOfMemoryError: Failed to create a thread message occurs when the system does not have enough resources to create a new thread" after long running, for example, after 4 weeks

Look into implementation I saw that both sync and async lambda request are using Futures

Checking metrics I have seen that the number of threads is always increasing, Is it may a thread leak?

Should the number of threads decrease when there is not activity for a while?

Any tips about that?

dinegri avatar Dec 05 '23 11:12 dinegri