Remove folder from sidebar

When I updated to Lion, a folder I had added to the Favorites in the Finder Sidebar stopped working. I can't drag it out or right-click it and remove it. Double-clicking it gives a message that the original item can't be found. Any ideas how to remove/restore the folder?

Thanks!