@ Tantram : can we chat about how the automated system work, pretty please? :)

DeathBurst·8/31/2016, 4:59:35 PM·2 votes·785 views

Hello,

So, I guess your day must be pretty busy, but since you regularly take time to come on the boards and answer questions sometimes, I'll try my luck.

From what I pieced together from various small comments, here is how the automated system roughly works:

  • Any report in a game flags it for review, but no actual review is made at that point.
  • When a given player receives "too many" reports, all their flagged games are reviewed.
  • For each flagged game, the system decides if the report is valid or not, and if there are too many valid reports, the player is punished.
  • Valid/unvalid reports also modify the report weight of people who issued these reports, which probably plays a role in what exactly is "too many" reports.
  • The validity of a report doesn't follow a fixed set of criteria, but instead relies on other valid reports to determine what the community sees as reportable.

So, am I right up to this point? If no, please do correct me. If yes, I have various questions on details:

  1. When a game is reviewed, are all players examined, or only the ones who were actually reported?
  2. It has been said that premades gang-reporting someone only counts as one report (so number of reports matters?), but that even a single report flags a game for review (so number of reports doesn't matter?). So can you elaborate on how exactly gang-reports are treated differently from "standard" reports?
  3. How can the system learn that emerging and new behaviors are reportable, since by definition, there is no pre-existing valid reports to support this decision? How can the system be able to both judge reports as valid or not and learn from them what is actually reportable? And how do you avoid the first players reporting a new behavior losing too much report weight until the behavior is recognized?

Hope you'll answer, and thanks for your work :)

Cheers o/

2 Comments

Zielmann8/31/2016, 5:10:21 PM3 votes

Actually, there's a key piece that you've got wrong, which should also help in clearing up your second question. The system will automatically review each game where a player is reported, and then flag it as valid or not. Enough valid reports over time will then result in a punishment.

So to address questions 1 and 2:

  1. Only the reported player's behavior is reviewed. So if there are multiple people that were causing problems in the game, be sure to report each one of them.

  2. Having each reported game for a player get checked for validity basically renders group reports pointless. Only one player needs to report somebody for their behavior to be checked for that game. if valid, it counts against the player as one instance. If invalid, it's thrown out. It doesn't re-check the game once for each report the person received, and it doesn't count as 'worse' just because multiple people reported. It's just one validly-reported game to the system.

As for how the system evolves over time, that's really a question for Riot more than anything else. I'm not sure if it learns over time or if they're manually adding things to watch for as they come up.