How to remove non-English voices?

You don't, they are baked into the OS just like the emojis or system sounds that you are also unable to delete. The OS is installed on a Read Only partition of your drive that prevents any alterations. That is also why you cannot have any viruses installed to alter any of those System files.

You cannot remove items installed by the OS. Just don't use them.