iotdb icon indicating copy to clipboard operation
iotdb copied to clipboard

[mlnode] Logging module, shut down function and the fixing of a bug about multi process training

Open ZDandsomSP opened this issue 2 years ago • 0 comments

Description

Logging module, shut down function and the fixing of a bug about multi process training We have developed new functions for the mlnode module of IoTDB, which mainly includes the following three parts:

Content

Logging module

Developed a logging module for mlnode, supporting standard function calls and localized log information for multi-process security

Shut down function

Completed the addition of the mlnode shutdown function, and implemented the direct shutdown of the mlnode main process based on the port number on the Linux system

Bug fixing

Fixed the issue involved in related work, which is that the original process pool does not support creating nums_ Issues with worker subprocesses

Usage

Logging module

We provide 5 levels of functions including debug, info, warn, error, and the module can localize logs according to the log level. In subsequent development, we only need to use a form similar to calling the Python standard logging module to use it.

Stop function

Since our start function is designed in the form of pip package, our stop function is developed in a similar form. If user start the mlnode in a terminal, we can stop the node in another one with the command "mlnode stop".

ZDandsomSP avatar Sep 20 '23 10:09 ZDandsomSP