Can't invite people to normals

It just says that the person is not eligible to join party, when they aren't in a game