dinky icon indicating copy to clipboard operation
dinky copied to clipboard

[Improvement] use sqllite or h2 or dinky server database to cache db data and mertrics data

Open Zzm0809 opened this issue 2 years ago • 2 comments

Search before asking

  • [X] I had searched in the issues and found no similar optimization requirement.

Description

en:

Currently, paimon is used as a cache medium for data source information and monitoring data. However, paimon's strong dependence on hadoop leads to a series of dependency and data problems that need to be optimized.

  • Option 1: Use spi method to expand and add new cache media of type sqllite or h2
  • Option 2: Directly use sqllite or h2 to replace paimon

cn:

当前使用 paimon 作为数据源信息和监控数据的缓存介质和监控数据存储介质,但是 paimon 强依赖 hadoop 导致一系列依赖和数据问题, 需要优化,且目前会导致内存泄露 方案一: 使用 spi 方式进行扩展新增类型为 sqllite 或者 h2 的缓存介质, 默认优先使用 dinky 服务的数据库存储介质 方案 二: 直接使用 sqllite 或者 h2 替换掉 paimon

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

Zzm0809 avatar Feb 29 '24 01:02 Zzm0809

Hello @, this issue has not been active for more than 30 days. This issue will be closed in 7 days if there is no response. If you have any questions, you can comment and reply.

你好 @, 这个 issue 30 天内没有活跃,7 天后将关闭,如需回复,可以评论回复。

github-actions[bot] avatar May 01 '24 00:05 github-actions[bot]

Hello @, this issue has not been active for more than 30 days. This issue will be closed in 7 days if there is no response. If you have any questions, you can comment and reply.

你好 @, 这个 issue 30 天内没有活跃,7 天后将关闭,如需回复,可以评论回复。

github-actions[bot] avatar Jul 01 '24 00:07 github-actions[bot]

已完成 #3613

Zzm0809 avatar Jul 18 '24 06:07 Zzm0809