sharlec

Errors when testing DCNS

24

Hi, I am trying to make the ifogsim and ifogsim2 running. They both have the same error messages as: Starting DCNS... Exception in thread "main" java.lang.Error: Unresolved compilation problems: The...

How to know which host does the VM allocated to?

2

I am studying on how does VM allocation policy influence the performance. I hope to know how does datacenter make the decision that which host should allocate which VM? Which...

world size assertionerror

1

I try to make the 7B model on my single GPU server, and I have error: ``` Traceback (most recent call last): File "inference.py", line 82, in run( File "inference.py",...

[Feature] 是否支持多主机并行？

2

### Is your feature request related to a problem? Please describe. GLM-130B的官方文档里支持使用FasterTransformer实现多主机多卡, 同样的步骤是否能应用在ChatGLM-6B上？Int-4的版本呢？ ### Solutions - ### Additional context _No response_

I was reading the documents and the technical paper, seems like the experiment are done in single Node. Does BMInf support to multiple nodes inference deployment for large model like...

Energon-AI Inference Optimization

1

Does it Energon-AI support this project for inference optimization?