Implement NPU daemon

[jyoungyun]

NPU daemon

Overall

Role

• Optimal management of NPU HW from runtime point of view
• Share NPU HW efficiently with 3rd party

Features

• Priority scheduling
• Core allocation
• Hardware abstraction layer

Relationship with ONE-Runtime

Architecture

This architecture will develop as it is implemented.

• NPU daemon library
  • User level API collection to request job to NPU daemon
• Core
  • Run background
  • IPC communication with application
• Scheduler
  • Prioritization between multiple application requests
• Resource manager(?)
  • NPU core management
• HAL (Hardware Abstraction Layer)
  • Interact with hardware device at a general or abstract level
  • Support hardware
    • TRIX

Implement

• Code location : ONE/runtime/service/npud
• Package dependencies
  • trix-engine (git://git.tizen.org/platform/adaptation/npu/trix-engine)

[seanshpark]

@jyoungyun , can you explain a bit more about this?

[jyoungyun]

Yes, I'm doing. This issue is created from https://github.com/Samsung/ONE/projects/8. So this issue was briefly created and I'm filling in the details now..

[seanshpark]

ONE/service/npud

I think this service is for onert(runtime). I suggest to move this into ONE/runtime/service/npud, as putting in ONE/service. I would think this service can be used in compiler (frontend).