matrixone
matrixone copied to clipboard
[Subtask]: refactor metric/log filepath as {account}/{megerd|log}/yyyy/mm/dd/{datatype}/*.csv
Parent Issue
Parenet Issue #5080
Detail of Subtask
refactor metric/log data in path {account}/{megerd|log}/yyyy/mm/dd/{datatype}/*.csv
-
{account}/log/yyyy/mm/dd/{datatype}/*.csv, store raw data directly from MO Node -
{account}/merged/yyyy/mm/dd/{datatype}/*.csv, store data from{account}/log/yyyy/mm/dd/{datatype}/*.csvwhich merged into one file (or a few files)
Describe implementation you've considered
we have 5 datatype: metric, statement, span, log, error
- data
metricstore in path{account}/*/yyyy/mm/dd/metric/*.csv - data
statementstore in path{account}/*/yyyy/mm/dd/statement/*.csv - data
span,log,errorstore in pathsys/*/yyyy/mm/dd/log/*.csv- these 3 type data will be store in one table (just named table
log) - just access by
sysaccount.
- these 3 type data will be store in one table (just named table
Additional information
No response