I'm working on two different Thunderbolt Displays; 1 at work, 1 at home. Can i just "pull the Plug"

I'm working on two different Thunderbolt Displays; 1 at work, 1 at home. Do I have to power my MacBook Pro down, each Time I change my location? Or can I just "pull the Plug" and reconnect at Home/work? Sometimes it won't wake up properly or doesn't recognize the other set of Bluetooth Mouse/Keyboard or Display wrong spaces in Mission Control...