datavines

datavines copied to clipboard

[Improvement] [DataSource] 数据源支持展示多个数据库

1

### Search before asking - [x] I had searched in the [issues](https://github.com/datavines-ops/datavines/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened 数据源添加页面，数据库字段设置为非必填，不填写默认加载该用户有权限的所有库   ### DataVines Version dev ### DataVines Config...

Chris-playground

For input string："false"

1

### Search before asking - [X] I had searched in the [issues](https://github.com/datavines-ops/datavines/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened 当数据质量配置了错误数据存储引擎时，偶然会发生For input string："false"类似的相关错误，是应为读取ResultSet 结果是没有指定具体类型，导致结果与数据类型不一致，需要修改src/main/java/io/datavines/engine/local/api/utils/SqlUtils.java 中getResultObjectMap方法 ### DataVines Version dev ###...

523300626

### Search before asking - [x] I had searched in the [issues](https://github.com/datavines-ops/datavines/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened 实际返回了long，前端对long展示不兼容，展示错误 ### DataVines Version dev ### DataVines Config ```conf dev...

bestboy

[Feature][Data Overview] One-Click Run and Schedule Data Overview for All Tables

1

### Search before asking - [X] I had searched in the [feature](https://github.com/datavines-ops/datavines/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ### Description Currently, in DataVines, triggering the data overview for multiple tables...

KONGHOA

### Search before asking - [X] I had searched in the [feature](https://github.com/datavines-ops/datavines/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ### Description ### datavines已支持“及时性检查”（英文freshness），在使用过程中发现如下几个问题： 1. 目前要求必须选“列”，且该列的字段类型必须为“datetime”类型，而生产环境中大量存在着“数据时间”类型为varchar或者int类型，此时无法使用“及时性检查”规则。 2. 在生成的脚本文件中，会用上date_format函数，要求对应的数据源需支持date_format函数，例如mysql支持该函数，而oracle不支持，就会导致oracle数据库不能用“及时性检查”规则。 `"sql": "select count(1) as...

18859108815

### Search before asking - [X] I had searched in the [feature](https://github.com/datavines-ops/datavines/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ### Description It is hoped that Datavines will integrate Kerberos authentication when...

github1733

### Search before asking - [X] I had searched in the [issues](https://github.com/datavines-ops/datavines/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened When running the data overview for a specific table, the...

KONGHOA

### Search before asking - [X] I had searched in the [issues](https://github.com/datavines-ops/datavines/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened 建议增加检查错误的筛选，如果检查比较频繁，任务多，分页查找检查失败的数据很不方便 ### DataVines Version dev ### DataVines Config ```conf 建议增加检查错误的筛选...

bestboy

### Search before asking - [X] I had searched in the [issues](https://github.com/datavines-ops/datavines/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened 测试数据源：oracle 跨表准确性检查 1、当Oracle表名太长，再拼数据库+表名+数字，表名超过数据库限制 SELECT '1' AS id FROM dual database_F_1111111_11111111_RECORD_1...

anan0120

数据质量Metric新增完整性校验

5

### Search before asking - [X] I had searched in the [feature](https://github.com/datavines-ops/datavines/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ### Description 后续能否新增基于数据日志的完整性检查，目前比较接近的检查方式包括“表行数检查”，“平均值检查”，但缺少完整性检查的metric，也即数据日志中记录了主数据的记录数，可以通过比较日志中的信息和计算出来的主数据记录数来比较数据是否完整。 感谢datavines开源团队。 ### Usage Scenario _No response_ ### Related issues...

18859108815