Can't change input source bug (Mojave)

Hello,

I'm having trouble getting rid of the bug that doesn't let me change my input source to any 3rd party input source installed manually on my MacBook. Although I have used the same custom input sources for about 7 years the same problem occurred to my MacBook for the first time on High Sierra and later disappeared by itself but recently when I updated to Mojave and formatted my Mac to factory settings the bug reappeared. The main problem is that whenever I'm trying to change the input source from the default US English keyboard to any custom third party language the bug reappears either by not changing the input source at all or just changes it and whenever I'm opening any other window the input source changes to the default one. (The input sources provided by Apple include Armenian and Russian language keyboard but the layouts are different, that's why I'm using the 3rd party ones)

Another interesting bug is that when I'm trying to add any other input source the window shows two of the same input sources added in the Library/Input Methods while there is only copy of each.

Is there anyone who had the same problem and maybe knows how to fix this?