iotdb icon indicating copy to clipboard operation
iotdb copied to clipboard

[Bug] Error WALBuffer....WAL-Recover Fail to allocate wal node....OutOfMemoryError: Cannot reserve 16777216 bytes of direct buffer memory (allocated: 469771426, limit: 471859200)

Open automatous opened this issue 1 year ago • 7 comments

Search before asking

  • [X] I searched in the issues and found nothing similar.

Version

1.3.0 3C3D

Describe the bug and provide the minimal reproduce step

image

We upped the JVM memory and still reported this error

What did you expect to see?

Cluster running properly

What did you see instead?

We can expand the memory

Anything else?

No response

Are you willing to submit a PR?

  • [X] I'm willing to submit a PR!

automatous avatar Jun 12 '24 05:06 automatous

It may happen when too many databases created. A limitation added in v1.3.2 can avoid this issue. https://github.com/apache/iotdb/pull/12431

HTHou avatar Jun 12 '24 08:06 HTHou

升级到1.3.2最新版本datanode还是报错,这个问题有修复吗? image

FutureHai avatar Jul 04 '24 05:07 FutureHai

@HTHou @automatous @wallezhang

FutureHai avatar Jul 04 '24 07:07 FutureHai

升级到1.3.2最新版本datanode还是报错,这个问题有修复吗? image

1.3.2 从新部署的情况下可以避免这个问题,但是有数据的情况下升级是不行的。database 和 data region 的数量太多导致的,建议调整建模,不要创建过多的 database。

HTHou avatar Jul 04 '24 08:07 HTHou

如果从新部署的情况下,数据库database太多的话还会不会出现上面的问题? @HTHou

FutureHai avatar Jul 04 '24 09:07 FutureHai

如果从新部署的情况下,数据库database太多的话还会不会出现上面的问题? @HTHou

新部署的话 database太多时会拒绝掉新的 data region 的创建,从而避免这个问题。

HTHou avatar Jul 04 '24 10:07 HTHou

麻烦再问一下,这个数据库数量到什么值时会拒绝掉新的 data region 的创建,大致能创建多少个数据库。 @HTHou

FutureHai avatar Jul 04 '24 11:07 FutureHai