Team Builder Timers

Can we get rid of the wait timers when players leave your lobby in team builder? I understand the need for them when a party leader is cycling though being really picky, but there is no reason to punish the lobby for when someone leaves it.