Personal Hotspot

When I change my personal hotspot password in my iPhone 6s Plus the iPad connects automatically. Is there a way to prevent other devices from connecting automatically? Every now and again I see the personal hotspot connected to two devices instead of the one. Even after I change my password, the iPad connects automatically. If I change the password this should not be the case. It defeats the purpose of changing the password.