iMovie green screen feature

I video myself in front of a blue screen and then use iMovie green/blue-screen feature to replace the background with an image. This generally works well however occasionally iMovie recognizes parts of my body as the background and removes them- which results in me looking somewhat transparent, like a ghost. I'm not wearing blue.

What can I do to solve this?