akhoroshev

icon location Saint-Petersburg

Results 46 comments of akhoroshev

Can not load module in Setup.hs

Same issue ``` OS: Debian 9.8 stretch HIE source build for 8.6.3 (lts-13.8) ```

Can not load module in Setup.hs

My log ``` 2019-03-01 11:20:49.526002938 [ThreadId 4] - run entered for hie-wrapper(hie-wrapper) Version 0.6.0.0, Git revision ba44c5841d687896c5f8101742ae2051fe1c6fbb (2434 commits) x86_64 ghc-8.6.3 2019-03-01 11:20:49.536708287 [ThreadId 4] - Current directory:/home/akhoroshev/Documents/fl_ifmo_2019_spr 2019-03-01 11:20:49.552053516...

[optimizer.cpp::computeCosts::1981] Error Code 10: Internal Error (Could not find any implementation for node {ForeignNode[Reshape_419 + Transpose_420...Gather_2423]}

I met the same error with trt **8.2.3.0** ``` [01/28/2022-07:54:29] [TRT] [E] 10: [optimizer.cpp::computeCosts::2011] Error Code 10: Internal Error (Could not find any implementation for node {ForeignNode[113 + (Unnamed Layer*...

[FeatureRequest] Collecting additional model outputs in `GenerationSession`

This feature will also be very useful for GptManager 1. https://github.com/NVIDIA/TensorRT-LLM/issues/595 2. https://github.com/NVIDIA/TensorRT-LLM/issues/868

Stop the generation if the eod is reached

@byshiue thanks for fixing in parallel gpt 😌 gptneox and gptj have the same bug? When I tested gptneox I met an same bug... Do you have plans for fix...

feat: json logging

https://github.com/userver-framework/userver/issues/180

Detected layernorm nodes in FP16.

tensorrt_llm-0.11.0.dev2024060400 ``` [06/09/2024-16:23:35] [TRT] [W] Detected layernorm nodes in FP16. ```

Detected layernorm nodes in FP16.

@nv-guomingz reopen please

Detected layernorm nodes in FP16.

@nv-guomingz I have no problems with the quality of generation, but this warning is very annoying. Previously @byshiue said that it should run FP32

Detected layernorm nodes in FP16.

[09/24/2024-14:02:00] [TRT] [W] Detected layernorm nodes in FP16. 0.14.0.dev2024091000 @byshiue reopen please