Memory not released
Skupper CLI: 1.6.0 skupper-router:2.5.2
The memory of the skupler router proxy has not been released
Can you please provide us with a skupper debug dump? See https://skupper.io/docs/troubleshooting/index.html#creating-a-skupper-debug-tar-file
We'll need you to capture the dump when the router is in the high memory condition so we can determine where the memory buildup is. Thanks.
skupper-router : 2024-08-09 12:11:03.803389 +0000 ROUTER (info) ram:30.83GiB vm:867.94MiB rss:486.09MiB pool:366.02KiB qdtm_router_t:64:0 qd_timer_t:192:0 qd_connection_t:288:0 qd_connector_t:128:0 qd_listener_t:64:0 qdr_addr_endpoint_state_t:64:0 qdr_core_timer_t:64:0 qdr_terminus_t:320:64 qd_management_context_t:128:0 qdr_action_t:256:576 qdr_field_t:320:128 qdr_connection_info_t:448:0 qdr_connection_ref_t:64:0 qdr_link_work_t:1280:128 qdr_general_work_t:448:64 qdr_delivery_cleanup_t:448:192 qdr_link_ref_t:3520:128 qdr_link_t:2752:0 qdr_delivery_ref_t:384:128 qdr_node_t:64:0 qdr_address_config_t:64:0 qdr_address_t:448:0 qdr_forward_deliver_info_t:64:0 qdr_delivery_t:46784:0 qdrc_endpoint_t:64:0 qdr_connection_work_t:448:64 qdr_connection_t:448:0 qdr_query_t:192:0 qdr_address_watch_t:64:0 vflow_work_t:320:128 vflow_record_t:128:0 vflow_attribute_data_t:64:0 qd_parse_node_t:128:0 qd_parse_tree_t:64:0 qd_parsed_field_t:88640:0 qd_message_content_t:23488:0 qd_message_t:46976:0 qd_log_entry_t:400:0 qd_iterator_t:51392:0 qd_hash_handle_t:512:0 qd_hash_item_t:512:0 qd_delivery_state_t:320:64 qd_pn_free_link_session_t:128:0 qd_session_t:512:0 qd_link_ref_t:46720:0 qd_link_t:2816:0 qd_node_t:64:0 qd_composed_field_t:448:0 qd_composite_t:448:0 qd_buffer_t:24992:192 qd_bitmask_t:23872:128 . . . 2024-09-04 07:11:04.174359 +0000 ROUTER (info) ram:30.83GiB vm:2.85GiB rss:2.48GiB pool:662.59KiB qdtm_router_t:64:0 qd_timer_t:192:0 qd_connection_t:480:0 qd_connector_t:128:0 qd_listener_t:64:0 qdr_addr_endpoint_state_t:64:0 qdr_core_timer_t:64:0 qdr_terminus_t:384:128 qd_management_context_t:128:0 qdr_action_t:320:5184 qdr_field_t:320:128 qdr_connection_info_t:704:0 qdr_connection_ref_t:64:0 qdr_link_work_t:2688:1024 qdr_general_work_t:448:64 qdr_delivery_cleanup_t:320:11328 qdr_link_ref_t:7872:1984 qdr_link_t:7040:1664 qdr_delivery_ref_t:384:9216 qdr_node_t:64:0 qdr_address_config_t:64:0 qdr_address_t:640:0 qdr_forward_deliver_info_t:64:0 qdr_delivery_t:5120:68736 qdrc_endpoint_t:64:0 qdr_connection_work_t:384:128 qdr_connection_t:704:0 qdr_query_t:192:0 qdr_address_watch_t:64:0 vflow_work_t:320:128 vflow_record_t:384:0 vflow_attribute_data_t:64:0 qd_parse_node_t:128:0 qd_parse_tree_t:64:0 qd_parsed_field_t:10176:142656 qd_message_content_t:2752:34304 qd_message_t:5376:68672 qd_log_entry_t:1088:0 qd_iterator_t:6592:114368 qd_hash_handle_t:704:0 qd_hash_item_t:704:0 qd_delivery_state_t:320:448 qd_pn_free_link_session_t:256:0 qd_session_t:704:0 qd_link_ref_t:5184:68480 qd_link_t:7168:1600 qd_node_t:64:0 qd_composed_field_t:448:0 qd_composite_t:448:0 qd_buffer_t:6688:32032 qd_bitmask_t:3264:34240
=========================================================================
proxy : 2024-08-09 13:14:17.993137 +0000 ROUTER (info) ram:30.86GiB vm:484.15MiB rss:67.22MiB pool:20.64KiB qd_timer_t:64:0 qd_connection_t:16:0 qd_connector_t:64:0 qd_listener_t:64:0 qdr_core_timer_t:64:0 qdr_terminus_t:384:0 qdr_action_t:256:256 qdr_field_t:448:0 qdr_connection_info_t:384:0 qdr_connection_ref_t:64:0 qdr_link_work_t:512:64 qdr_general_work_t:448:64 qdr_delivery_cleanup_t:448:128 qdr_link_ref_t:640:64 qdr_link_t:384:128 qdr_delivery_ref_t:384:128 qdr_address_t:128:0 qdr_forward_deliver_info_t:64:0 qdr_delivery_t:320:512 qdrc_endpoint_t:64:0 qdr_connection_work_t:384:128 qdr_connection_t:384:0 qdr_address_watch_t:64:0 vflow_work_t:192:256 vflow_record_t:448:256 vflow_rate_t:128:192 vflow_attribute_data_t:448:1984 qd_parse_node_t:64:0 qd_parse_tree_t:64:0 qd_parsed_field_t:640:1536 qd_message_stream_data_t:256:128 qd_message_content_t:512:320 qd_message_t:576:512 qd_log_entry_t:80:0 qd_iterator_t:576:128 qd_hash_handle_t:128:0 qd_hash_item_t:128:0 qd_delivery_state_t:384:64 qd_session_t:128:0 qd_link_ref_t:448:0 qd_link_t:256:0 qd_node_t:64:0 qd_composed_field_t:384:0 qd_composite_t:384:0 qd_buffer_t:240:544 qd_bitmask_t:128:0 qd_tcp_adaptor_config_t:64:0 qdr_tcp_connection_t:112:288 qd_tcp_connector_t:64:0 qdr_tcp_stats_t:64:0 qd_adaptor_config_t:64:0 qd_adaptor_buffer_t:320:80 . . . 2024-09-04 07:14:18.351782 +0000 ROUTER (info) ram:30.86GiB vm:1.68GiB rss:1.45GiB pool:1.31MiB qd_timer_t:64:0 qd_connection_t:16:0 qd_connector_t:64:0 qd_listener_t:64:0 qdr_core_timer_t:64:0 qdr_terminus_t:384:0 qdr_action_t:256:384 qdr_field_t:448:0 qdr_connection_info_t:448:64 qdr_connection_ref_t:64:0 qdr_link_work_t:576:64 qdr_general_work_t:448:83072 qdr_delivery_cleanup_t:384:114368 qdr_link_ref_t:832:128 qdr_link_t:576:128 qdr_delivery_ref_t:320:192 qdr_address_t:128:0 qdr_forward_deliver_info_t:64:0 qdr_delivery_t:66048:44672 qdrc_endpoint_t:64:0 qdr_connection_work_t:448:64 qdr_connection_t:448:64 qdr_address_watch_t:64:0 vflow_work_t:320:192 vflow_record_t:448:29376 vflow_rate_t:128:192 vflow_attribute_data_t:832:329920 qd_parse_node_t:64:0 qd_parse_tree_t:64:0 qd_parsed_field_t:704:176576 qd_message_stream_data_t:320:256 qd_message_content_t:66240:45376 qd_message_t:66304:104384 qd_log_entry_t:1056:0 qd_iterator_t:576:128 qd_hash_handle_t:128:0 qd_hash_item_t:128:0 qd_delivery_state_t:384:128 qd_session_t:128:0 qd_link_ref_t:384:28800 qd_link_t:256:0 qd_node_t:64:0 qd_composed_field_t:384:0 qd_composite_t:384:0 qd_buffer_t:200400:64 qd_bitmask_t:128:0 qd_tcp_adaptor_config_t:64:0 qdr_tcp_connection_t:144:256 qd_tcp_connector_t:64:0 qdr_tcp_stats_t:64:0 qd_adaptor_config_t:64:0 qd_adaptor_buffer_t:608:192
@kgiusti Are these logs what you want?