Disappearing Mouse

When I go to play in full screen my mouse cursor disappears, making it very difficult to play. If I make it windowed it re-appears but it doesn't look or play as well as full screen, as I can not click on anything that is located behind my task bar and I am unable to move the screen while in game. It is very irritating. While trying to figure out my settings (very hard to do without a cursor) I got an afk warning that took forever for me to hit ok on because I couldn't find it!!

Please fix or give advice asap