Can't Delete/Rename Smart Mailbox

I don't seem to be able to rename or delete smart mailboxes in mail. I control-click to choose Rename or Delete, I can temporarily change the name or remove the mailbox, but after quitting and relaunching mail the old smart mailbox with the old name is still there. Happens on both my laptop and desktop, both running 10.9.2.