node-subtensor memory leak when running lite-node on mainchain

[baonq-me]

Describe the bug

Memory usage of node-subtensor is rising continuously.

To Reproduce

Start a lite node on the mainchain by following this instruction https://docs.bittensor.com/subtensor-nodes/using-source

commit 1332d077ea73bc7bf40f551c7f1adea3370df2bd (HEAD -> main, origin/main, origin/HEAD)
Merge: aec052a0 99253056
Author: Unconst <[email protected]>
Date:   Tue Jul 23 16:32:49 2024 -0500

    Merge pull request #657 from opentensor/rajkaramchedu-patch-1-1

    Update README.md

Expected behavior

Memory usage should keep around several GBs

Screenshots

Environment

Ubuntu 24.04, arm64 architecture, rustc 1.80.0

Additional context

subtensor-exporter.txt

[SFuller4]

Could this be causing the panics that people have been experiencing as tagged in #655? If the memory is still being held onto after a restart it would explain the continuing issues.

[orriin]

Could be related. Thanks @baonq-me for reporting, will investigate this.

[baonq-me]

34GB more since yesterday

[distributedstatemachine]

@baonq-me is this still an issue ?