Using jabra bluetooth headset with magic mouse causes audio interference in headset

- I am using a MacBook Pro (13-inch, Mid 2012).

- I use the Jabra Sport Wireless+ bluetooth headset: http://www.jabra.com/Products/Bluetooth/JABRA_SPORT_/Jabra_SPORT_

- I recently purchased a Magic Mouse and connected it to my MacBook.

MacBook is able to connect to both devices successfully

Now, whenever I connect my Jabra headset with my MacBook and my Magic Mouse with my MacBook, I get a lot of audio interference on my headset. As soon as I disconnect my magic mouse, the audio interference goes away.

Is there a setting or configuration that I am missing? Or this is how it is supposed to be?

- ANIKET