How can I disable Voice Control on my iPhone 5S?

I have an iphone 5S and just within the last few days the feature, "Voice Control" has begun to randomly turn on and randomly turns on my music. I can be watching a video or a program and Voice Control comes on and makes me lose what I was watching. I cannot figure out how to disable this feature. I have turned off Siri but Voice Control still comes on without me touching the home button or anything. Please help. Thank you.