Kinesis Advantage2 keyboard input breaks when switching out and back from terminal

[Zerophase]

If I switch out of the current terminal to another key presses are no longer interpreted correctly. With other keyboards this doesn't happen to me. Would setting xkbd-model fix this issue? I've tried the keyboard id and name without any luck so far. It just stops kmscon from starting up.