I read what Lyte had to say about it. Quite a bit of what Lyte had to say about it. Here's a solid summary of what they had to say about it, posted in the old forums by Ulanopo:
"I don't like that the system is 100% automated."
A certain amount of automation is necessary to meet the objective of the system: to provide feedback and correction in hours instead of days.
We know that the system is not entirely automated. link
You assume there's no human element. There's just less player involvement, but Rioters are heavily involved always.
"Automation" might not mean what you think it means: link
We'll look into revealing some context and information around some of the experiments in the future. We're trying a lot of different things while Tribunal is being upgraded, and "automated" was probably the wrong word to use.
By "automated," we simply meant that it is possible for a penalty to be handed out more quickly after a negative action. Sometimes in the Tribunal a negative action would happen and it'd be a month before the player received a notification or feedback about it.
This makes it sound as though "automation" is a streamlined and accelerated process that puts the case in front of the reviewer faster than the Tribunal, rather than a system that has little to no human input.
From WookieeCookie: link
The system is not automated at all currently. This wave of bans, and the wave of chat restrictions prior have been the result of close collaboration between a number of teams including Player Behavior and Justice, Business Intelligence, Player Support, and our regional offices. Human interaction has been a core component of each step the entire way through.
Additional clarification from Lyte link
There also is a lot of supervision over the restricted chat system. In fact, we have a few teams that review players that are queued up for chat restrictions and are constantly analyzing the accuracy of the system through manual checks and algorithmic checks. "Automated" was probably the wrong word to use, because all it really means is the ability to automatically assign penalties to players at a much quicker pace than the Tribunal was able to, while also doing it in-game with notifications instead of via e-mail many hours or weeks later.
At this time, I believe that the 5-game restrictions have minimal human oversight, while the 30 and 40-game restrictions are assigned manually.
Keep in mind that there are MANY things they cannot discuss regarding the inner workings of the chat restriction system.
- For some percentage of the restrictions, the algorithm flags accounts for manual review. Someone from Player Support then looks at the account history to determine if a restriction is warranted.
- We do not know what percentage of accounts undergo manual review.
- We do not know what criteria the reviewers use to determine if a restriction is warranted.