Dragon Fire Soul Bug

I just lost a game today because some went to clear a ward and it triggered fire soul starting the elder dragon before we wanted to. it made us lose the game and as far as i know it shouldnt trigger on wards and such right? cuz that would make it impossible to clear wards on objectives if you have soul without immediately starting it as a result