DeepSpeedExamples icon indicating copy to clipboard operation
DeepSpeedExamples copied to clipboard

can not run the test-gpt.sh because of assertionError

Open leachee99 opened this issue 1 year ago • 0 comments

hi, I meet a problem when I run the DeepSpeedExamples/inference/huggingface/text-generation/run-generation-script/test-gpt.sh.

The error is :

assert not config.replace_with_kernel_inject, "Cannot use both user specified injection policy and kernel injection"
AssertionError: Cannot use both user specified injection policy and kernel injection

How can I solve this problem? Thanks

leachee99 avatar May 16 '24 03:05 leachee99