What was the disruptive change in terms of positional embeddings?

[BramVanroy]

It was a pain to install the requested version of transformers (well, actually its tokenizers==0.7.0 dependency) on our cluster. So I am hoping to contribute a fix to make the library compatible with recent transformers versions. Can you give a bit more information about the issues you experienced and what the problem is?