Ihor Stepanov

icon indicating a website link https://www.linkedin.com/in/ihor-knowledgator/

icon company Knowledgator Engineering icon location Kyiv, Ukraine icon location I am excited to develop AI systems for the expenditure of human knowledge.

Results 3 issues of Ihor Stepanov

add creation of out2 dir

normalize names of files with embeddings

Flash Decoding in Triton

I have realized flash decoding algorithm in Triton, however, performance boost is not significant. Unfortunately there is a limitation of block size to perform dot product in Triton. The minimum...