Game alt tabs out unexpectedly

Sometimes the game tabs out unexpectedly for me. Ive talked to 3 other people this is happening to. For me it seems to be when i press the hotkey for my item 6 slot. This slot happens to be bound to my mouse. So who else is experiencing this?