Safari won't let me remove an extension

Safari won't let me remove the Honey extension, it keeps saying it can't remove it because it is in use even though I already unchecked it in extension settings so it is not on Safari anymore. I just want it off my computer. I checked to make sure it wasn't turned on/in use and it isn't but it still says it is when I try to uninstall it in applications.