Safari Pop Up Window Settings Issue

There are some specific websites I need to change the pop up windows settings in Safari from block and notify to allow. When I go to the Safari Settings and select the dropdown window in Websites/Pop-up from block/notify to allow for the website I am on, the selection just flips back to block/notify. What can I do to make the selection stay on allow?