Siri Speak Screen

I love the new Siri Speak Screen function when I want it, but it commonly randomly kicks in when I don't want it. Even if I'm not using my phone and it's in my pocket and when I have it on silent mode. Please help me stop this. I'm running on iOS 8.3. Thanks!