"Riot should just make a list of banned words" and how not to be condescending.

RallerenP·2/5/2019, 9:08:14 PM·77 votes·21,134 views

very long post tl;dr (and more) at the bottom

Ok. Let's make a list. This will be a list over words that will be banned in a hypothetical game.

  1. Pizza
  2. Hamburger
  3. Fries

Great. Our list, while bad, is now complete. But wait. What happens when someone then writes 'Pízza'?

Oh well, we'll just add it to our list

  1. Pizza
  2. Pízza
  3. Hamburger
  4. Fries

Hmm. But now someone could just 'Pizzza', right? Ok, say that somehow we can manage to know every single variation of the word 'Pizza'. Of course, we'd also have to know every other variation of every other word on our list. So:

  1. Pizza, etc..
  2. Hamburger, etc..
  3. Fries, etc..

Now this list is already unusable. There'd be a thousand different variations of each word.

And what if we branch out. In hypothethical game, we actually don't care about people that say's Pizza. It's OK, Pizza isn't inherently offensive to us.

It's eating pizza that is the problem.

So would the list now look like this?

  1. I like to eat pizza
  2. I like to eat hamburgers
  3. I like to eat fries

But people could just phrase it differently i.e. 'I enjoy consuming pizza'. Ok, so we figure out all the different variations of sentences you can use to describe eating pizza.

  1. I like to eat pizza, etc..
  2. I like to eat hamburgers, etc..
  3. I like to eat fries, etc..

So now the list actually may be unending, because there could theoretically be a unending amount of ways to say these things.

Oh, and you also have to avoid every singe variation of every single word in these sentences.

Ok, lets say that you can magically do this. You've found out a way to list every single combination of phrases, including every variation of every word.

What happens when someone says 'I like to eat pizza' and someone else responds 'me too!'?

You'd need a list of all phrases describing eating pizza, with all possible variations of words used in those sentences, and all variations of all responses that would indicate that you agree with that sentiment of enjoying pizza, including all variations of words to possibly use in those sentences.

Ok, you have that. You have the list. The extreme, infinite list of banned things. (Funny thought really, since the amount of banned things to say is infinite, there are as many banned things, as there are allowed things)

What happens when the chatlog looks like this:

PizzaHater34: Wow, I really hate pizza PizzaLover12: I like to eat pizza

No problem, right? Well, now 'AgreeMan34' chimes in:

AgreeMan34: Me too!

What is he agreeing to? There isn't actually a way to know. Do you punish for this deplorable act, or not?

Ok, let's just say that you have godly powers (which you have, since you've made an infinite list, know every variation of the phrase 'I like to eat pizza' and every possible variant of the words in that sentence). You make a list that also have perfectly maps every response to every sentence.

No one else can read it. It's infinitely long.

So you summarize it. The general idea is: Don't advocate eating junk-food.

A couple of weeks later, someone write on your forum: "You should really make a list of what can be punished".


This is the problem developers have been facing since the dawn of times. Censorship in games fucking sucks. You cannot make a list.

You and I know exactly what not advocating eating junk food is like. But computers are deterministic. They don't know.

But we can teach them. You and I are pattern finding geniuses. We are experts in the field. We do it impressively well, literally before we are born.

When we see a phrase saying: "I enjoy consuming pizza", we KNOW what it's about. Even if we had NEVER seen that exact phrase before, we know what it means. That's because we are pattern finding experts. We can from our past experiences determine what that phrase means. And only because our brains work so well, can we know what each word means, and dynamically create an understanding of the sentence.

A computer can actually do that aswell. You teach it. The principle can be called 'machine learning'. Riot actually employs a subgenre of machine learning: Neural Networks. They function almost as our brains does, but they are initially empty.

You feed the computer data. You show it an example of someone saying they enjoy pizza. Then one more. Do this for as long as you can, but you don't need to give it an infinite list. Also give it list of data with examples of someone NOT saying that they enjoy pizza.

The computer will now be able to take in an input (i.e. 'I like pizza'), and determine whether or not that input is actually advocating eating pizza.

Riots algorithm works on this principle (Although, I have MASSIVELY simplified it, there are MANY more variables than the ones I mentioned), but it works with toxicity. It can actually do all the things you can't make a list of.

The data Riot uses for it's algorithm comes from reports (although, a single report wont significantly affect it in ANY way to prevent false reports from clogging it up). That way, if something becomes offensive, when it previously wasn't, the algorithm can instantly respond.

But a side effect of this is that, just like you can't possibly make a list, the computer can't either.

TL;DR

The list would end up being infinitely long, you generalize it and someone complains that you haven't made a list.

Epilogue

I mostly copied what I wrote above from another comment I just made, so sorry if it seems weird and out of place.

I know I'm also mostly preaching to the choir, but not everyone thinks of computer and algorithms in the same way. Some people genuinely don't know why making a list is impossible, and it's not because they are dumb. For the same reason a lot of people intuitively know why it's impossible, a lot of people think that it is.

All our previous experiences leads us to determine something. We know that it's impossible because we've had the right experiences to know the logistics. We kind of understand how computers and development works.

But a lot of people also see computers as magical things that can do anything, because they've previously experienced incredible things without ever wondering about the underlying mechanisms.

I see a lot of people fall down the rabbit hole of condescendingly explaining things to players on here (I've done it myself, so no hard feelings). And not just towards those who also responds in a hostile way.

I often see posts of players actually wondering why they got punished, and someone just responds 'nice to see the system is working' or 'I hope you get permabanned'

So I'd like to think that my (overly long) explanation of why you can't make a list is an example of a way you can explain something (that you find extremely intuitive) without being a dick about it.

If you're a dick about it, you'll just leave a discussion with no parties having learnt anything.

All I'm saying is, that there is a reason why Player Behavior gets called unsympathetic and rude. And of course, you don't need to stretch out an explanation as long as I have (it's too late at this point, I might as well have written a fucking novel).

And while it may be an unpopular opinion, it's one thing the moderators of these Boards actually do quite well, IMO. They are often patient and will explain things while not being pricks about it. (Of course, I HAVE seen cases of moderators being pricks about it aswell, and it always leaves a sour taste.)


I initially made this post on EU Boards, but felt like it belonged here too, especially since this is the most active of the two.

81 Comments

Deep Terror Nami2/5/2019, 9:21:59 PM32 votes

[slayer-pantheon-thumbs]

ModPeriscope2/6/2019, 1:17:24 AM11 votes

I made it halfway through the post before calling Dominos. Damnit.

AntiSJW2/5/2019, 10:14:20 PM7 votes

This system doesn't measure emotional responses in reaction to goading or trolling. I know its been pounded out again and again that "2 wrongs don't make a right here" but that standard is far heavier on the ones playing in it trying to have a good time. Its never felt fair that a troll not triggering said "list" while they for sure throw the game is "less punishable" than Joe Smoe Average getting pissed in chat. Trolling is bad, and all around rampant, but we see hammers swinging away at chat indiscriminately. I've seen it overreach many times too so there is only so much it can do.

It feels off . Especially with Riot's weird stance of "we can't tell you how effective your reporting is, but keep it up and trust us!"

Now to directly address your post. Well said, well explained. I wish standards would change. Its not necessarily bad to want to clean up chat or keep certain language out, but having a system that takes away rewards in addition to restrictions + possible permaban over words is over kill. It as a system will always have to be measured next to how well player integrity is being enforced (IE - not stealing roles or trolling etc). Its clear that they are failing hard in keeping player integrity up

Arcade Lulu2/5/2019, 9:28:40 PM4 votes

[sg-kiko]

World peace plz2/5/2019, 9:32:58 PM4 votes

[sg-lux]

Minimac20002/6/2019, 1:07:37 AM4 votes

As amusing as this post was.... I have to point out a mistake.... you said that since the list of banned things is infinite and the amount of unbanned things is infinite that there as many unbanned things as banned things however, it has been known for a while in mathematics that there are greater and lesser infinities. It's pretty clear that the list of banned things would be a greatly inferior infinity to the list of everything

Wolfeur2/6/2019, 1:10:50 PM3 votes

Don't forget that once everything pizza-related is banned, people will just start saying "I'm italian" as slang.

Jesus is Savior2/6/2019, 9:36:36 AM3 votes

tl;dr bring back the tribunal. Computers suck.

Astrovert2/7/2019, 12:10:17 PM2 votes

I generally witness many people being toxic in League that probably don't even realize they are being toxic. They are just so casually toxic they think being toxic is their right to everyone everywhere. So when they finally get punished they cant understand what happened.

As is the case 99% of the time, the problem is YOU not everyone else YOU

Mr Elessar2/5/2019, 9:35:20 PM2 votes

Why doesn't Riot just block irregular letters, but yea it's an issue that you can get away with typing words using irregular letters.

Also wondering why Mods haven't removed this for "encouraging abuse of the IFS".

GreenKnight2/5/2019, 10:02:14 PM2 votes

Well. Kudos to you sir. Can i link your post to people who refuse to listen to me?

Velzard of Koz2/6/2019, 1:37:14 PM1 votes

You realize majority of this can be resolved by regexp?

Cowseed2/6/2019, 6:39:29 PM1 votes

No offense but I think this post is terrible. You can simple say "Pizza is banned" add another rule "Slight variations in the spelling of the words while still trying to hold the same magnitude of offense as the original word"

You play the philosophical game if you want but as human beings a certain level of comprehension skills is expected.

I'm not a violator of this rule. Its just that your reasoning sounds dumb.

Morgana Deus2/6/2019, 6:43:12 PM1 votes

What if as a gaming company Riot focused on gaming. Gasp. What if big boys and girls didn't have to be penalized for every word they said. Gasp.

Right now there is an adult who's job is to look into bad words said on a video game. That's an actual job. Can you imagine anything more useless?

Zéychin2/6/2019, 6:52:21 PM1 votes

To teach a computer to fully comprehend the nuances of spoken language and culture of humans is an infinitely long process. We can teach a computer to process, but not to feel. and even if it's processable toxicity in its plainest form, the sheer difficulty of parsing language, ESPECIALLY as non-standard as people tend to write online (bcuz sumt!m3s p0eplecy hit tge rong keés or mispeil dfghjksdfiu8786 tgings), is enough to call off the search for a "perfect" detection system.

There are so many ways to avoid reasonable detection of toxicity.

Toxic Person: Hey Thresh. Go look up article [X][Y] of the consitution of the world's foremost superpower and look at the first letters of the [A],[B],[C],[D],[E],[F] words. That's what you are.

Now take this, but rewrite it in broken Internet dialect (missed keys, alternate letters in spelling, non-standard homophones, garbage, as above)

No reasonable detection system for an online video game is going to find this, but a person reading it would reasonably be expected to easily interpret the meaning of the message. A specialized supercomputer like IBM's Watson might be able to figure it out after extended deep-learning training, but it would hardly be reasonable to expect a gaming company to develop a supercomputer and deep-learning algorithm to detect this. Human reviews will remain crucial in identifying anything subjective in online interaction for the foreseeable future.

Envy Sin2/6/2019, 4:26:53 AM1 votes

They should employe the making of the mobile game hackers. Litterally a filter for every lanague known to man every possible way to subvert it results in a instant chat ban for a scaling amount of time 30 mins 60 mins 120 mins 240 mins ECT.

The only way around it is to spoof a blank keystroke as a space that shows as a letter

So the system sees " uck" or " hit" ECT. Which the mods instantly ban.