Ok I have managed to reproduce this issue, with intent. It goes like this.
I play a game, set the head set down for a couple minutes, return and put the head set on and it is all about this issue. Seems pretty straight forwards, although one small detail I only realized this morning... I am setting it down outside the play area on a desk top. If I set it down in the play area, I don't get this issue. So I would guess, the boolean, or more then likely the switch, is having issues recognizing the play area, as it likes to drag the play area around with the headset, while I am looking around in the play area.