Apple Configurator Profile can be deleted by user.

Our apple configurator certificate was about to expire, so as there is no way at present to simply update the certificate I created a new certificate and decided to re-supervise all our iPads! However, even though the Certificate is now no longer red as before there is a Delete button meaning any user can just delete the certificate. Does this mean the iPad would no longer be supervised? Why is there now a Delete option? Please see photo.