Player Behavior Design Values: Punishment

Riot·3/19/2015, 11:04:05 PM·1 votes·78,556 views

TLDR: We believe punishment is most effective when structured towards reform, because other designs often address symptoms, not root causes. Walling off the overflowing garbage room might hide it for awhile, but the smell sticks around and you aren’t any closer to having a clean house.

Hey everyone!

We’re here to wrap up our Player Behavior dev blog series. We’ve already discussed reform and reward, and now it’s time for punishment. It’s important to note that while punishment remains the most obvious way to deal with negative player behavior, we only utilize it in very specific circumstances. We only outright punish players when we’re really, really sure (false positive rates below one percent) a punishable offense occurred.

In every other case, we believe punishment should be structured to encourage reform. Drevarius explores an example of that in action with chat restrictions, but first Lyte tackles the core problem with Prisoner’s Islands (where negative players are matched with other negative players in a separate queue) and why ranked restrictions don’t create one.

Before we dive in, it’s that part of the blog where we reiterate our overriding philosophy on player behavior in online gaming: there’s no silver bullet. We strive to find a mix including punishment, reform, and positive reinforcement.


Why “Prisoner’s Island” is almost always bad for everyone

Prisoner’s Island, matchmaking negative players together, is a tempting, obvious solution to combating poor player behavior, but it’s ultimately just lazy design that only encourages further negativity. As players are exposed to more negative behavior, they just become more likely to quit playing any particular game--up to 320% more likely, in fact. That old saying about everything looking like a nail when all you have is a hammer applies here; low priority queues can work well in one very specific situation, but that doesn’t mean you can extend it to every player behavior problem.

When players know and understand exactly what lands them in the low-priority queue, they also know exactly how to return to unrestricted matchmaking.

We do use low-priority queues in League of Legends with LeaverBuster, a system that recognizes AFKs, leaves, and rage-quits. But even in that situation, as clear-cut as it gets (a player knows when he or she ditched his or her teammates,) we still steer towards reform first.

But if the behavior becomes a pattern, the player is punished with low-priority queues, forced to wait before entering matchmaking.

But what about ranked restrictions? We’ve seen some players concerned that by removing negatively-behaved players from the ranked queue into normal draft, we’re creating a Prisoner’s Island and just calling it something else. The key that makes ranked restriction different is that the overwhelming majority of players in normal draft are still neutral to positive. By slowly and intentionally introducing a very small minority of negatively behaved players and keeping them chat restricted during their path back to ranked play, we don’t disrupt the queue and players can compete in a more relaxed atmosphere as they work to reform.

With both LeaverBuster and ranked restrictions, social pressure acts as a lever, encouraging reform. We’ve found the approach of surrounding bad behavior with good influences tends to lead to the best results for improving the experience and helping the community actively reject negative behavior. Next, Drevarius finishes up the series by addressing how chat restrictions fit into our punishment philosophy.

-Lyte


How turning chat into a resource management game encourages reform

Hey everyone! I’m Drevarius, a designer on the team behind chat restrictions.

We wanted to design a system to discourage bad language and outright abusive communications. Again, punishment should encourage reform, so simply muting foul-mouthed players treated the symptom, but failed to create a solution where the player could learn and improve their communication skills. After a number of tests, we landed on chat restrictions, a punishment that hard limits the amount of team-wide chat messages a player can send per game.

Limiting the number of messages a player can send turns chat into a limited resource. This messaging “ammunition” can either go toward useful comms that help coordinate a successful gank or toward flaming an underperforming teammate. Chat restrictions challenge players with a resource dilemma and a moral decision.

Since most players want to win, the clear choice between helpful comms and negativity leads to a substantial reduction in most chat restricted players’ negativity. Many chat-restricted players realize using chat positively has an impact on their win rate. Because of this, some chat restricted players even asked to make their restriction permanent! When we compare the old ban-first, ban-later strategy regarding negative language to the new combo of chat restrictions and bans, we’ve seen 40% more players reform in the new system.

-Drevarius


Why we believe League is only going to keep getting better

League’s currently at an all-time low when it comes to AFKs and leavers, and the community’s taken a hard stance against racism, homophobia and sexism. Cumulatively, only 2% of games globally include excessive harassment, racist, homophobic,or sexist language.

There’s still work ahead, and knowing that you’re experiencing something rare doesn’t help when it’s still horrifying and disappointing to see in game, and we know negative experiences linger in a way positive moments don’t.

Moving forward, we want to make it even easier to be positive. We’re also making it more convenient to find and play with your friends through expanding Suggested Players and new features like Party Rewards. We’re not done yet and we’re looking forward to working with the community to make League even friendlier. Good luck, and we’ll see you on the battlefield!

751 Comments

KT Ekko3/24/2015, 11:13:33 PM352 votes

Add reporting in champ select, thats where most of the toxic stuff is said anyways.

Xonra3/24/2015, 11:20:53 PM121 votes

I have to be honest, since joining nearly 5 years ago now, player behaviour has if anything, gotten significantly worse, and not even a little better.

Even over the past year, I have seen more "Trolls" in ranked specifically, more people seeming to feel more comfortable about raging or being rude, and people will bluntly tell you to report them because they know they won't get punished like they would have even with the old tribunal. Riot seems to be targeting verbal issues 90% and afk issues 9.9% and maybe issues otherwise .1% at most.

There is no punishment for people who troll in champion select because they want a role, or those who intentionally feed, people that troll build (no, it isn't okay to go full ap on Cait and try to jungle).

The tribunal needs to come back 6-7 months ago as Riot on their own don't seem to know how to properly deal with these cases, and as they are getting more frequent, aren't doing much of anything about them. I can mute a rager, I can't mute someone from intentionally feeding.

skullzx73/24/2015, 11:54:16 PM79 votes

"Cumulatively, only 2% of games globally include excessive harassment, racist, homophobic,or sexist language."

Well I've gotta be the unluckiest person ever then cause I'm somehow hitting every single one of those 2% games.

Love My Yandere3/24/2015, 11:25:50 PM60 votes

The key that makes ranked restriction different is that the overwhelming majority of players in normal draft are still neutral to positive.

The key that makes ranked restriction different is that the overwhelming majority of players in normal draft was neutral to positive but ever since ranked restriction it became neutral to negative.

FTFY.

In your (Riot) definition of toxic is a negative attitude that infects other players making a neutral player negative or a positive player neutral. In your own definition of what you are trying to stop you contradicted yourself.

only 2% of games globally include excessive harassment, racist, homophobic,or sexist language.

What world are you on? Is this for the tournament realm client globally? while sure racist, homophobic or sexist language is low because that requires knowledge of who you are playing with/against but there is way more then 2% excessive harassment. In over 10% of my Coop vs AI games there is "excessive harassment" I am lucky to get in a normal draft game where a player you can tell is rank/chat restricted because he will say one line every 5 minutes and it will be an insult about 30% of the time. Another 50% just have some guy on tilt getting pissed (at least I assume, I really hope he just isn't a troll) and the other 20% is actually nice... I would really like to see how you get the numbers considering you don't even look at reports considering you use an automated system now.

If you want people to be positive, not just neutral, make rewards for only the positive players, make use out of those stupid ribbons that you only see once every 50 games anyway people have over 500 "teamwork" and never been chat restricted. Make a "reward" for losing so the people who just lost a game doesn't feel like they wasted an hour of their lifes even if it is something small because guess what? 50 IP is useless when you unlocked everything and have over 50K IP.

Me personally I say gj (good job) whenever my team makes a play and mb (my bad) when my team mistake that isn't my fault because I don't want to see them fight. But you know what, if they do we have a nice feature in the game called the Mute feature where you ether type "mute player name or ALL" or click on the microphone symbol when you press tab (by default) for the scoreboard. This would be the best way to combat negative language and allow you to focus on other stuff like what people complain about all the time. The trolls who intentionally feed or afks or someone picks AD Ziggs first time Ziggs in diamond 1 elo then goes 0-10-0. Like just create a video that randomly takes place (and forces you to watch) in the client after games (like say after every 5 or 10 games) to demonstrate how to use the mute button and block feature (the client version of the mute button).

I hope my points are clear. I really don't want to do a TL;DR because all of what I said I think is important. I hope you stop trying to sell your business to the public media and actually try to help the community like you advertise.

PS: Better nerf Irelia

Mac Tíre3/24/2015, 11:53:51 PM58 votes

I notice that the attacks of special needs people have not been addressed. Too many times I have seen the term autistic being used. Not cool. This illness is not as uncommon as you think. Me personally am not but I have 2 nephews that are. and one thing to get me to go off on you is to start using the term like its cool or something. Rito, if you are gonna address some of the stuff that is at a low. Address the stuff that is still wrong. and this is assuredly one of them. 3/5 games I see someone calling someone autistic. Stop the bullying, and the degrading of others.

Stephenizgod3/25/2015, 12:15:34 AM39 votes

Im sorry but i respectfully disagree with it getting better. More then 50% of my games there is someone being verbally abusive to someone. You may say that its just 1 game out of 10 that they are like this but the point is they are being incredibly offensive in that 1 game. Punish them? No not necessarily but you must realize that there are thousands of players all being toxic in 1 out of 10 games. This results in more then half the games i play being full of negativity. League is just Toxic, you miss a minion and suddenly you are told to kill yourself, god help you if you miss another...

Not saying im perfect or that i expect perfection, im just saying please stop fooling yourselves, make no mistake this game is full of toxicity. Trolls in ranked run rampant with seemingly no consequence as i can see they continue to troll 3-4 games after trolling me. AFKers still AFK because they dont see any long term punishments or they just dont care. Toxic players just stop talking for a few games so they dont get consistent reports... It might just be that Bronze and Silver have the worst of the worst, but thats where a large portion of your community is placed so for those who try to not be toxic are stuck in this unholy hell-hole and feeling like they are forsaken by Riot.

Whítenínja3/25/2015, 1:35:08 AM36 votes

Can we have rito actually read chat? Most of the time when I get reported it's because someone is being very toxic and so I tell them "I'm going to reportRiven for being toxic." And then I get a chat restriction for verbal abuse.... thanks rito

Epyon Avenger3/25/2015, 4:33:07 AM35 votes

Am I the only one who would be HAPPY if those people stuck in the "Prisoner's Island" left the game? Really. I get it. Rito doesn't want people to leave because it's less chance for them to make money, but it's the BEST scenario for the other players if the toxic ones are locked up together and either dig deep and "reform" or GTFO.

Cosnirak3/25/2015, 12:44:43 AM30 votes

Your numbers on how bad things are seem rather off. Between streams and my own play I see a large variety of players at all sorts of ranks (and unranked) and things are far worse than you make them out to be. They're still better than ever and better than many other games, that much I believe.

But "cumulatively, only 2% of games globally include excessive harassment, racist, homophobic,or sexist language" is a flat out lie. I have a hard time believing anyone at Riot actually believes that and I'm certain <1% of players believe it. You might counter with some lax definition of 'excessive harassment' but by any reasonable definition there is excessive harassment in A LOT more games than 2%. Spend one afternoon as a team just reading all the chat from random bronze ranked rift games until you can't take it anymore. I dare you! And yeah I know, that's probably the hot bed of the worst of it, but it shows up in everything from bot games to challenger too.

A ton of stuff goes unreported. A ton of reports of VERY awful behavior result in 0 action taken to reform or punish. Your IDEAS about what to do to correct bad behavior and encourage good behavior seem great but you consistently screw up the details. Some people can't queue for 5+ minutes because they missed one queue pop while others say down right cruel and demeaning things to their teammates over 1 or 2 minor missplays game after game and NOTHING HAPPENS. As the saying goes the devil is in the details and you guys are royally screwing up some of the details.

One minor solution that I feel would help a lot and no one seems to talk about is improving the jump from unranked play to ranked play. A lot of people meet the requirements to queue for ranked but are clear outliers in skill compared to the average player there. This tends to create a lot of problems. Supports who constantly try to cs and take clarity because they don't understand the game isn't about just killing minions fast end up fighting against people who have 200 ranked game wins and made gold last season. Please help newer players learn the basics of both fighting and overall game strategy sooner and easier, for everyone's sake.

Grrrrr3/25/2015, 12:38:22 AM29 votes

Vote option in lobby. Let us Vote people out. 3 votes = gone

Beerstein3/25/2015, 6:27:55 AM25 votes

I've played since quite some time before season 1 and I can honestly say the toxic levels in this game get worse every year.

I applaud Riot for putting forth such extreme efforts to curb toxic behavior but whatever you're doing it's making it worse. Your punishments create multiple accounts, new players have to deal with them. Pre lvl 30 essentially IS a prisoners island, and guess what happens to the new players that have to go through that cesspool? They pick up off the worst of the worst in the community and are likely to come out toxic themselves.

You ban peoples accounts for verbal reasons and send them to smurfs. I've said this several times over the years, you're perpetuating the problem.

I play WoT and account bans are super super rare which are for instances of cheating, botting etc. You know what happens to people that are verbally abusive? They get a temp chat ban (24 hrs) then 3 days, then 7, then a month, then 6 months, then permanent. You know what the result is? The toxic levels in that game is peanuts. The punishment system for verbal offenses is verbal punishments, and even then they're super lenient yet over the years it's fostered a long term improving environment.

Stop banning accounts for verbal reasons, ban people from chat for verbal reasons. Ping spam? Restrict people to being able to use all but the MIA ping, abuse that? Take it entirely. But STOP account banning over verbal reasons. You're only sending these players down to harass new players in a MUCH worse manner on accounts they don't care for. This community is 1000x more toxic than it used to be. Also 1-30 is 1000x worse since new players that are positive are usually run off the game if not hiding in bots. Oh and that makes the ones that DO want to PVP suffer that much worse of an environment as others literally hide in bot games from your prisoners island. So instead they often have to deal with bot accounts on their own teams when this happens!

TheEvoDragon3/25/2015, 12:40:24 AM20 votes

"League’s currently at an all-time low when it comes to AFKs and leavers" I've had 3 4v5s in ranked in the last 2 days... 2 were in a row and even got me demoted. Riot if you guys could add some sort of an LP loss reduction for situations where a player leaves for the majority of the game that would be great.

Fenrisulfr3/25/2015, 1:12:34 AM19 votes

And this is where Riot ultimately fails...their punishments.

Chat restriction may allow one to make 'moral decisions' on if they either flame or communicate, but when it comes down to it, you're only hurting the player completely. Pro players like Dyrus have already complained that ping spams ruin the experience and are incredibly annoying due to their nature and how you cant squelch them. And since, if a person is using their INCREDIBLY limited to praise a player (to more quickly get their account back into a 'positive' standing through that), they use up their 'ammo' to communicate important things. Pinging things like Dragon/Baron/Other objectives with just a ny of the ping types don't actually or accurately portray what they player is trying to say. Specifically if a chat restricted player sees an enemy take dragon and they want to report to the team about the timer on drag (if vision isn't available, so the timer itself won't start ticking). Turns out, they won't be able to since, ya know, they're chat restricted.

And since we're doing all this, horrendously repeated, talk of rewards, reforms, and punishment, none of it matter! Tribunal is still down and hasn't come back up. As someone who has willingly received one report and ONE warning about being negative, and being slammed with both ranked AND chat restriction, I know that its based upon the number of reports recived and, not at all, about the accuracy of the reports! It's just an automatic witchhunt of a system that is currently broken and won't get fixed with the tribunal no matter how many false reports and 'labels' you put down on players (aka, majority players are neutral, etc.). Its click-bait and filler of false information to just make one believe the game has gotten a lot better than previously. I'd rather see 'punishment' go out to people who are making bot accounts and adding everyone constantly instead of toxic people that I can just mute.

But I guess for now I'll continue to get into a game and under 10 minutes in am asked 'who I bought my account from' and 'to uninstall' because I'm having a bad game but have a great skin....yet I'm the one who gets reported and restricted while others go untouched.

CyberKai3/25/2015, 5:21:40 AM18 votes

I let a friend of mine try and play this. She played the tutorial. Then the battle training. Then he tried playing a PVP game. She quit about 5 minutes in because everyone on her team yelled at her when she gave up first blood. Until everyone realizes that this is only a game, its not going to get better at all.

ˆayy3/25/2015, 1:02:07 AM17 votes

I would like to point out that in my experience positive and neutral players rarely take a leadership role because they are afraid of getting reported, and while I may have been chat-restricted for negativity, I like to point out people's mistakes and how they could improve. This often leads to the harassment message popping up which makes me sad and not want to help people. Im done ranting, just pointing out that many players simply ignore chat, so they aren't really affected by positive players that much.

Pucking Purrfect3/25/2015, 1:06:15 AM17 votes

Cumulatively, only 2% of games globally include excessive harassment, racist, homophobic,or sexist language.

LIES...

Lord Macaroni3/24/2015, 11:08:33 PM15 votes

Funny how toxicity of premades in solo queue isn't addressed at all in any of these posts, but is probably one of the top reasons people have a negative experience in any particular game.

Slam Garbage3/25/2015, 4:10:41 AM14 votes

A kick vote system in champ select? I think if we had this for ranked it would make the game much more healthy. You wouldn't have to dodge. it would be like a surrender vote, 3 or 4 votes for the kick to work. ( 3 in case of duo) The last pick urgot jungle would just get kicked for 5 mins or whatever and you would requeue. Just a thought.

Gmesh3/24/2015, 11:31:11 PM13 votes

Before I start I want to say that I like how competitive League is. It's nice that everyone has the urge to win, not caring about winning (In ranked of course) is not acceptable.

However It feels as though it is NEVER okay to lose. If you lose you have to find the reason WHY. Was it the jungler? Someone fed? Well it surely wasn't you! It seems LoL corresponds to many player's own ego. If the culture could just shift away from the "do-no-wrong" attitude and the occasional loss being at least ACCEPTABLE, the game would be in a better place...

dakoslug3/24/2015, 11:30:26 PM13 votes

I really hate the negativity towards prisoner island. It's designed to really punish negative players. The fear of being in prison island I think would defer any acts of toxicity. For example, pretend i was recently put into prison island LPQ. It would be a terrible experience and I would never want to be in it again, right? So having the constant fear of being punished in such a way should be a good deterrent to continual acts of chat abuse.

LCS DoubleVision3/25/2015, 7:27:50 AM10 votes

I don't get it. The problem with toxicity has to do with chat.. Yet there is no way to disable chat and even if you do mute someone they can see what you say.. Why not fix that problem and add an option to disable chat if you don't want it or when someone is muted they can't see what you say, That way you can be as toxic as you want and release the beast and no one can see it but you?

As someone once said- The reason people are toxic is because you are helpless to do anything in a game with trolls. For example, If you were playing basketball game and some dude says, pass me the ball everytime or i'm going to go score for them you would simple not play with them.

In league you don't have that option.. You are either stuck with that person for 20mins + of you have the option to dodge/afk but get punished for it and that is why people are toxic because they are helpless to do anything against people going out of their way to waste your time because they didn't get a position they wanted or just troll to troll.

Simple Fix. When you mute someone make it to were they can't see what you type so that way you can let off steam but they can't read it. Why they can still read what you say even though you mute them is beyond me but chat options is the way to combat toxicity since that is where it all goes down.

In other words, you can't change human nature as easily as you can add chat options. If someone wants to be toxic let them, just give the option to where if they choose not to mute you then when you mute them they can't see what you say.. problem solved.

It doesn't take a PHD to figure that out.

Otto Attack3/24/2015, 11:33:56 PM9 votes

Can we fix the fact that if afks buy an item the team doesn't get loss prevention, cause I'm still getting that crap.

Night and Arrows3/25/2015, 3:19:52 AM9 votes

This is a good example of toxicity: Now I consider myself a pretty positive player, maybe others dont but i dont know. One time when i was jungling a game, top called for a gank. The Riven there was being super aggressive and had already died twice. She was fighting her opponent, so i signaled her to back off and wait for me becasue i knew she would die before i got there. When i did, she responded with, "stfu" Do you know what i did? I turned right around and went to help someone who would appreciate it. She clearly didnt need my help if she told me that. Now, maybe that wasnt the best or nicest thing to do but I DID NOT want to help her after she said that. Afterward, she cussed me out for pinging and then abandoning her but she was just a rager, was from the start. That just shows you how just one negative comment can turn a helpful person (at least i hope im helpful) into a jerk.

Maybe some more rewards would be a good idea......just spitballin'.

Mystrwolf3/24/2015, 11:41:16 PM8 votes

why is kale always the champ for Player Behavior Design Values why cant it be someone that people are scared of like Teemo