iotdb icon indicating copy to clipboard operation
iotdb copied to clipboard

[To rel/0.13/tsfile-viewer] [IOTDB-4104] Develop a tsfile visual management tool

Open lpf4254302 opened this issue 3 years ago • 1 comments

Background introduction

I hope to develop a tsfile file visual parsing tool to provide guidance for IoTDB beginners and as a debugging tool for IoTDB developers. The tool can display file binary details (not implemented in the first version) and detailed file structure. At the same time, the binary area can also be performed with the visualization area. linkage so that developers can better understand. Currently, it supports bit granularity analysis of TsFile (V3) file structure and provides a clear and hierarchical visual interface for data area and index area.

The main function

Currently supported TsFile version: V3 Display information about each level of the data area and index area:

  • TsFile file information display: such as VersionNumber, Size and other information.
  • Data area display: Display meta information, statistical information, detailed data, etc. at each level according to different levels.
    • ChunkGroup
    • Chunk: DataSize, data type, compression type, encoding type, etc.
    • Page: uncompressed size, compressed size, statistics; show its detailed data according to the logical structure of aligned time series and unaligned time series.
  • Index area display: Displayed in a data structure similar to a B+ tree, you can view the overall structure of the secondary index (divided into four layers: INTERNAL_DEVICE, LEAF_DEVICE, INTERNAL_MEASUREMENT, LEAF_MEASUREMENT).
  • Time series search: The loaded time series directory structure can be retrieved in a fuzzy manner.
  • Physical quantity data search: The set of data points written to the qualified physical quantity according to the three conditions of time range, DeviceID and MeasurementID.
  • Analysis of the encoding type and compression type of the time series: Provides the current encoding type and compression type of the time series, as well as the encoding type and compression type of the combination of each encoding type supported by the data type of the current time series and each compression type supported by IoTDB analysis results.

Architecture choice

The C/S architecture is adopted, and the client is developed using JavaFX.

lpf4254302 avatar Aug 15 '22 05:08 lpf4254302

Hi, please add a UserGuide in docs.

Add to complete

lpf4254302 avatar Aug 17 '22 01:08 lpf4254302