Getting dropped from team builder with no notification

When I join a team I keep getting dropped with no notification. For instance I was waiting in team builder for around twenty minuets and only got an error message when I tried to leave the group. This happens when I lead a group and even sometimes after I've hit ready. Is there a way i can fix this?