openvino
openvino copied to clipboard
Use array for tracking memory usage instead of map
Details:
- Any additional locking and synchronization on memory allocation might have negative impact on MT execution.
-
std::maphas very slow access are requires lock on every access. We can usestd::arrayinstead to hold compile time known number of buckets. -
arraycontainer has lower access latency and memory overhead. - We might me able to remove mutex lock on stat collection.
build_jenkins
Hi @ialbrecht, any data with concrete numbers on how it can affect MT execution in your case?
Hi @ialbrecht, any data with concrete numbers on how it can affect MT execution in your case?
We had benchmarks were memory allocation was on the critical performance path and we were looking at all possible ways to optimize it.
build_jenkins