Atze00

Absolute positional embedding present with ALiBi relative positional encoding.

7

Hi. To the best of my understanding, this line of code should be like this: ```python self.has_pos_emb = position_infused_attn or rel_pos_bias or rotary_pos_emb or alibi_pos_bias ``` https://github.com/lucidrains/x-transformers/blob/a9de3a837ae69c917d8e26e71b967f750be6a1d2/x_transformers/x_transformers.py#L675