Haowen Hou

incense 0.0.10 cannot support the FileSystemExperimentLoader

2

Hi， I pip install incense. but I find the pip distributed version cannot support the FileSystemExperimentLoader. Will you release a new version to fix it? Thanks a lot

actually, your model is not the same as the original paper. original paper use dynamic pooling and your model use max-pooling. Do you want to update your model to dynamic...

Current FLA RWKV6 implementation has significant precision issues in pure bf16 mode

1

The current FLA RWKV6 implementation has significant precision issues in pure bf16 mode. Below are the results from my experiments: CUDA bf16 (fp32 internal): y: 0.0016603531206355376 gr: 0.0017877683404764239 gk: 0.0017853925508536652...