Player Behavior Design Values: Reform

Riot·Dec 16, 2014·2 votes·83,933 views

TLDR: Meaningful feedback can result in reform rates as high as 70% when the feedback loop is short. We designed ranked restrictions with penalties for negative behavior tailored to the motives of ranked players and with less time between the triggering behavior and the feedback.

“In our first player behavior design blog, we explored why there isn’t a silver bullet to solving negative behavior in online games. Reform is critical to our design philosophy because less than 1% of players are persistently negative enough to trigger a major punishment such as a 14-day ban or permanent ban.

Reform becomes increasingly likely the shorter the feedback loop (the time between the negative behavior and receiving feedback that the behavior was not acceptable). With ranked restrictions, a player who behaves negatively enough in a game receives feedback the same day the negative behavior was detected. If ranked restrictions are issued, that player can't enter ranked until they win a certain number of games in a lower-stakes queue (Normal Draft for most regions).

Some of you already know him, but Socrates is a designer who worked on ranked restrictions here to go a little deeper into the system, and explore why this particular design works so well.”

-Lyte

Ranked Restrictions

Feedback is critical, but as we mentioned, it has to be the right feedback delivered in a way that is meaningful to the person receiving it. For example, ranked players have different motivations from players who stick to non-ranked modes.

Skill improvement and ladder progress -- Playing to get better at the game and have fun climbing ranks

Serious competition -- Playing ranked because it is the most competitive mode where everyone has opted in to trying their hardest to win
Social comparison -- Playing to compare rank to other players
Rewards and tangible accomplishments -- Playing to earn rewards at the end of the ranked season

Before ranked restrictions, we weren’t giving the hyper-competitive solo-queue player the right type of feedback at the right time and they might play through any number of warnings or punishments up until his inevitable permaban. By locking these players out of ranked queue, we throw up a barrier between them and what they are most motivated by. To take the barrier down, they have to improve their behavior to be more in line with what the community expects, reinforcing positive behaviors and promoting reform.

With ranked restrictions, we used an advanced machine-learning model to instantly recognize negative behaviors the community rejects. Through end-of-game reports, honors and historical Tribunal records, we were able to analyze millions of games in order to identify negative behaviors and build a faster feedback loop.

We don’t always share numbers, but because we are only talking about ranked games (meaning all accounts are active in ranked queue and Level 30) we felt these are pretty easy to make sense of without a ton of extra context. Since introducing ranked restrictions, verbal harassment reports in ranked games dropped 18%.

After identifying some of the motivations behind ranked play and designing a system that provides meaningful penalties related to those motivations, the percentage of ranked games with moderate negativity fell 28% (from approximately 1 in 8 games to less than 1 in 10), and the percentage of ranked games with high levels of negativity (such as death threats, sexism, racism or homophobia) plummeted 47% to 0.8% of all ranked games.

Feedback is Everything

"In this blog, I re-emphasized our philosophy around reform and why we reject the notion of a silver bullet to slay negative behavior. Then Socrates explored how ranked restrictions work and why they are so effective. In the next blog, Drevarius plunges into a deeper dive on punishment, and how we approach penalizing negative behavior differently. For example, our decision to remove ranked rewards from the most negative players was in line with the motivations Socrates discussed in this blog, and represents a different approach than always resorting to the banhammer.

Thanks for reading; we’ll see you on the battlefield!"

- Lyte

458 Comments

ShawkeekeeDec 17, 201466 votes

Scenario: A Kalista Kalista item 3599 oathswears YOU Soraka (the support) while red team invades your jungle 3 v 5. You cannot move during a oathsworn animation and are immediately rooted and killed.

Do you:

A.) "Haha. We all make mistakes, don't worry about it." B.) "RLY? You ******* moron. Maxing Q and don't expect me to use my W on your ***." C.) AFK

XFortuityDec 17, 201411 votes

D? All of the above?

SUNBURST96Dec 17, 201436 votes

F) Feed

ChekkoDec 17, 201418 votes

D.) Please dude, dont do this again, learn from your mistakes.

AssassinsØnlyDec 17, 2014274 votes

E), act like they are your friend, proceed to friend them after game, build trust, duo que with them, play teemo in their promos, troll, feed, GG WP, laugh, unfriend, block :)

II ReVenGe IIDec 19, 201441 votes

That is so evil. I love it.

Wind WhistlerDec 19, 20149 votes

Then get banned and/or realizing that you used more time doing the entire thing than the person you did it to will have recovering.

slippykittenDec 19, 201418 votes

And then laugh even harder as THEY get banned for raging at you while you are totally in the clear for a ranked teemo feed game.

JsKingBooDec 17, 201413 votes

Don't respond and pretend nothing ever happened.

PentaWattDec 18, 201454 votes

Soraka BANANA.) Throw bananas. Win. Profit.

NssheepsterDec 18, 201437 votes

D) Remember to never use a squishy support with Kalista, because if you do half the situations her ult is good in, will kill you. Also try to avoid supporting a Kalista in the future unless you know the player or are voice chatting with them. For the moment, simply act as if it didn't happen and proceed. At a second time of dying because of this player, mention it and ask for some courtesy.

TheisdarkstarDec 18, 201430 votes

giving no fucks, proceed to build full AD soroka and ks EVERYTHING

Meanie40Dec 23, 201428 votes

L) Move to top lane and support your top laner instead.

xXSomeoneElseJan 6, 201549 votes

actually had this happen had a cait morg bot and I was vlad, well cait was being insanely toxic to morg calling her useless waste of a sup and to leave lane and stop taking her exp, so I was like come on up here morg, we have a campfire and toast marshmellows and proceeded to poop on the renekton I was laning against.

TheKingBadger5Jan 7, 20156 votes

The one thing I don't like about this stuff is, is when I'm in skype with my support and he still flames me for not being able to do damage (my score 0/0/6) (his score 6/1/0)Its my fault he died because I didnt do enough damage. The Morg and Jinx we are against scores are 0/3/0 and 0/3/0. But i cant go top or mid because I will be useless to the team and get yelled at by the team I'm on. This probs doesn't make sense but its stupid. There needs to be a way to report people for deliberately doing troll things?

ydnar1Jan 6, 20158 votes

do oathswoen in base

NuaranDec 18, 201453 votes

tl;dr

Riot guys you just do not understand some situations. So let me give you an example.

I am playing top.
We have a mid.
I give first blood, then proceed to 20th minute with score 1-3 because I got ganked once and underestimated the enemy and got killed. I also got a gank once where my ignite killed the opponent. I have same CS as my lane opponent
At the same minute twentieth, Lux is 0-0 with 30 less CS than their mid who was the one to gank me at top to get his kill before ganking bot lane after that getting another kill and assist there.
So we have a 2-1-1 top laner, and a 2-0-1 mid laner on the enemy team, I am top 1-3-0, and our mid is 0-0-0 with -30 CS.
Their top laner goes mid while I take top tower. My team fights them for some reason and they all die.
Bla - bla - bla and we proceed on to lose the game.

So, in this situation, they harass me several times before I cannot stay calm anymore. These situations are:

I give first blood:

...
RLY?
idiot

I got killed because I failed to kill my laner and he escaped with 50 HP:

...
GG
are you ***ing kidding?

Zed ganks me and I die, while killing one of them:

well at least you got one
GG DUDE YOU SUCK
uninstall pls you moron

I get top turret while they all die mid. They deny my pings to fall back and not fight while I'm taking top. Then they initiate the fight and all die:

[all] gg report renekton
[all] report renek
[all] gg report pls

We proceed on to losing our inhibitors because I build tanky and lux has no items because she is still 0-0-2 with 100 cs at 35th minute and lacks tons of damage. Our jungler failed to smite a dragon once and the enemy team has three dragons while we have one:

[all] gg this renek...
[all] gg wp
[all] gg report renekton thanks

Meanwhile my responses had been like:

- Oops
- Damn sorry..( Please gank
- Nice mia Lux thanks...
- Guys please let me take the turret

Please wait
Dont fight while Im here taking turret
Wait
...

- Lux get Zhonyas

[all ]This Lux... no mias, no damage, and she says report renek

But, of course, as everyone on bronze, silver, and gold just sees 1-3-0 on renek, they say they lost because of me and no one gives a damn **** about lux not doing any damage.

After I see that all 4 members of my team are against me I start cursing and they all report me.

Then I get banned for 2 weeks because I get these kinda teams every damn day.

Yxion the YordleDec 18, 201469 votes

I think this game is actually called: "League of Perfectionist Elitist Pricks Who Criticize Any Small Error You Make Way Out of Proportion and Blame Everything That Goes Wrong on You" But the name would be too long so they shortened it down to "League of Legends"

thewoundupknightDec 18, 201454 votes

Trust me, it's even worse when you,re support. You lose a game: Finish the game 0-3-10? Reported for feeding Finish 3-0-10? You're KSing the carry Finish 0-0-9999999999? Reported for "not helping" and people wonder why nobody supports well in low ELO.

NuaranDec 19, 20148 votes

IKR. That's why I hate supporting at this level (bronze, silver, gold. idk about plat anb higher), because they think you should buy all wards while you can only put 3 and then rage at you because you don't have a ward somewhere. and when you are 1-8-23, and you died 8 times because you had been shielding your carry, for example, from Lucian ult, like 5 times. And they still call you a feeder...

jzakillaDec 24, 201418 votes

well said, I play mostly support, and I never have a problem finding a spot in team builder. No one wants to play support because if things go wrong, it's your fault, if things go right, it's the ADC's mad skills. Regardless, your ADC is going to spend the whole match pinging you trying to tell you what to do...

AbodyHUN666Dec 18, 201413 votes

Mute really helps a lot. If a guy starts flaming 10 min into the game he won't really say anything useful for the rest of the game. Turning off all chat helps a lot too, most of the times it's only used for requesting reports anyway.

Grandmaster IMIDec 18, 201446 votes

Allow me to interject here. I am a ranked player with quite literally thousands of games. I have seen the best of players and the worst of players. This system is flawed beyond belief. Why? Because the very essence of the reports themselves and peoples' attitudes in general. There are MANY times that if you report a player for his or her crappy behavior, you will get reported right back. It is so easy to abuse the reporting system it's not even funny. We do not have an "Unsportsmanlike Conduct" report either...which would be VERY helpful. Do you ever get that enemy that gets really fed by your [insert negative descriptive adjective here] teammate and then said enemy player decides to badger the fact that they are fed and act like they are "it" when really...they are probably no better than anyone else. This also does not address the EXTREME problem there is with people who "smurf" and literally RUIN games unless you happen to be lucky enough to have someone on your team of equal or greater skill. It is hard to "stay positive" whenever an enemy is CLEARLY in a place where they do not belong. You report this? Big whoop...it's not [yet] a technical "offense". This system is sort of like communism (PLEASE NOTE THIS IS A SIMILE, NOT A DIRECT COMPARISON)...that is, it is perfect in theory, but in reality, it is a dismal failure. In real life, what normally happens to people who are being annoying, arrogant, and/or mindless pricks? They normally are not spoken to softly and happily...especially when they ruin things. The very heart of the problem, I have found in my years of playing is that there are two types of player...1) those that CARE about ranking and treat League as a "sport" not a "game" [I heard a very good definition that the difference between a "sport" and a "game" is that in its very core, a "sport" is not all about having "fun"...it is about winning and avoiding losing; whereas, a "game" is all about having fun...win or lose] and 2) those that do not give two cares whether they win or lose...or cause other people misery based on their dumb decisions. I have found SO MANY PEOPLE in the "ranked" system that aren't even there to win...which is really pathetic...this goes against the very core design values of what the ranked system is! Players like this should at first be ASKED by the system after a certain number of "Assisting Enemy Team", "Intentionally Feeding", and "Negative Attitude" reports as well as "Unskilled" whether or not they even take League somewhat seriously. If they answer "no", they should be asked to consider NOT PLAYING RANKED and if the problem persists, ranked should be disabled for a very long time on their account until they complete a large number of "Draft Pick" games...because let's be honest...the vast majority of players that do "Draft Mode" do so in order to prepare/practice for RANKED GAME-PLAY. This is a major problem and in at least 50% of the cases I see, this is the main issue with players. They are the ones who are like, "it's just a game". Actually, no it is NOT "just a game" when you get to higher levels and RANKED play. Go tell that to the professionals who make a LIVING of this program. Note that it is called "eSports" not "eGames". Until THIS problem gets fixed, Riot will CONTINUE to have a very at-odds community--it's just simple logic. No one at Riot listen though...they think they have it all worked out and need no help. They do not listen to the player base telling them clearly what the problems are...choosing instead to rely on MORE PEOPLE FROM RIOT! This is like having a medical problem and instead of going to the doctor, you go to your best friend [who is not a doctor]. Riot, LISTEN PLEASE!

X9SquaredDec 25, 20142 votes

What happens if League is a hobby for u and you like to play it?? I wouldn't want to get banned from Ranked play just for saying that League is my hobby and I don't take it as seriously as a sport like soccer or swimming or whatever? Even I would say that only real pros would take League as seriously as a sport or even as a part of their daily lives (no offense Doublelift, still luv ya [NO I'M NOT GAY!!!!])

aw34hgw4hDec 28, 20148 votes

I imagine that isn't exactly what he meant. i have no way of proving it of course, but I imagine that seeing it as a hobby is putting more care into it than not caring about win or lose. And honestly, this is a sport, a team sport at that, so if you aren't giving enough effort to actually win where wins matter, then you probably shouldn't be playing ranked. A team only does as well as it's weakest link, and if you happen to be so, then I think being a little upset is completely fair. I also see it as more of a hobby, but if I wasn't allowed to play because I'm not putting enough effort into winning, I have no problem with that. Normals and Draft pick norms are sufficient enough for me.

Yokel85Dec 17, 201444 votes

So how much did the verbal harassment reports increase in normals when you decided to punt the poorly behaved ranked players into them?

Mistress MadokaDec 18, 20148 votes

A ton T^T

JudgeMeisterDec 17, 201430 votes

The only thing I really dislike seeing is the comment about how "Positive Summoners win 70% more games", or some bullshit like that. If you're negative, you were probably losing to begin with. I mean, hopefully you understand that you're dealing with a population prone to losing anyways (the time most people rage). More likely you're just trying to encourage people to be more positive by posting misleading stats.

XFortuityDec 17, 201440 votes

Ummmmmm did you have a bowl of pissie attitude for breakfast? It's a game! No reason to be negative at any time! If you are having fun and couperating while talking nice you will do better. Would you do better while cussin your face off or playing with a good attitude.... Hmmm I wonder

LucasDec 17, 201424 votes

When you get targeted almost every game by a troll or griefer who intentionally spoils the game for you and does whatever is in their power to put you behind and make you miserable, try keeping a positive attitude. I know from experience, it is almost impossible. More of these people exist now because instead of just afking, they put their team behind to try end the game faster. People who do this on the opposite ruin it even further, it is not fun winning a stomp because one player ruined the game for their team.

AddygilDec 17, 201427 votes

I miss funny tribunal cases :( (Todd will 1v1 you m8)

amwagnerDec 18, 20149 votes

You're name is Todd, no wonder you're so mad. Nami

ConnorGamer1299Dec 18, 201417 votes

Your*

CountessNovaDec 19, 20143 votes

Actually... It's no wonder you are so mad.

Seth the BumDec 19, 201416 votes

I believe ConnorGamer1299 was speaking of amwagner's first usage of the word, as in, "Your name is Todd."

BluewoodDec 17, 20146 votes

Shaco item 1038 summoner 14 Garrison << know wot I meannn >> ;)

MaeolanDec 17, 201440 votes

nope, not at all

not a starburstDec 18, 201498 votes

Shaco. Shaco is a jester. Jesters are like clowns: they both wear makeup and kids are afraid of them both, even though they're supposed to be harmless entertainment. Clowns. Clowns are typically found at a circus. In a circus, you can find lots of acts. Some of those acts are knife tricks. Knives? Swords are just really big knives, basically. Swords. B.F. Swords. B.F.F. Swords. B.F.F. How do lose your B.F.F.? Don't run ignite against Aatrox? Aatrox. Aatrox starts wars. In wars, the defending side is often besieged. Siege. Siege towers. On Dominion, the best Summoner Spell that deals with towers is Garrison. Garrison. Summoner Spells. There are 3 summoner spells in the post. What else has 3 sides? A triangle. 1 item? 1 eye. Triangle? Eye? Ludus Oak confirmed for Illuminati.

tylercilerDec 18, 20142 votes

really Illuminati profe plz no...

not a starburstDec 18, 201429 votes

WAKE UP SHEEPLE ILLUMINACHO IS EVERYWHERE

DarklordHanzoDec 17, 20144 votes

Theres honestly just one problem with all this anti-toxicity...Whos to stop any of us from getting reported for trying to tell newbies they ain't playin right. Cuz in most circumstances you don't have the ability to take corrective action respectably, and by the time the games over your probably too frusturated to even bother.

What I'm saying is...I'm playing this game to have fun, and oh win a good portion of the time...not teach.

Mistress MadokaDec 18, 201496 votes

You're going to have to deal with New players. That's just how it works. It's not your Job to teach them, either. Regardless, No matter what you're doing, it's no excuse to be rude. as an example:

WRONG: Ashe : Hw do u recall Hecarim : Alt f4 faget ~~A CHAMPION HAS DISCONNECTED~~ Teemo : I don't want to be in this ELO anymore...

STILL WRONG: Ashe :hw do u recall Hecarim : omg fkin noob press b

Correct: Ashe : hw do u recall Hecarim : you press b.

DarklordHanzoDec 18, 201411 votes

I find it rather hard not to be rude when their all running around the map like chickens without a head getting slaughtered...thus feeding the enemy team and ensuring our loss.

I honestly wish it was an issue as simple as not knowing how to b...

speedofsound125Dec 18, 201460 votes

if they are running around the map getting killed, you're either in a really low ELO or you're playing with new players. If you're in a low ELO and dont deserve to be, you can (and probably will) get out with a little patience. If you're playing with new players, constructive criticism (hey try to play it safer like this) or just tell them they did a good job if they do a good play. It's like an ADC. you need to support them early and give them a bit so that they can be an asset to the team. If you support the beginners or even the people that arent as good, they'll become better players from it and you'll feel a lot better than if you just raged at them and got a ban for it.

AndadogJan 7, 201514 votes

Wow some reasonable people on league? I thought I would ride a unicorn before that.

KuroMitsukiDec 18, 20145 votes

Case B is actually correct. You are allowed to be an ass, just be an informative one.

RedesignatedDec 18, 201436 votes

No, not really. If you're being an ass, you're being an ass, and that's bad.

DarklordHanzoDec 20, 20144 votes

Can we just appreciate the little grey area's? Honestly these issues aren't gonna be fixed by being so black and white about it. Not everybodies gonna be in the hold your hand, walk you through it kinda mood. In most cases people wouldn't be being an ass if you learned how to play right in the first place. Instead of taking things personally (Cuz this is the internet guys, who cares. Not like your gonna see the people you queue with on a regular basis.), take away the attitude and you got yourself some constructive criticism.

Name me one person here who didn't learn from people CAPS LOCKING

Mistress MadokaDec 21, 201427 votes

The only things I learned from caps locking

CAPS LOCK IS CRUISE CONTROL FOR COOL
A reason to find the Mute button.

Being an ass is never necessary. You don't need to hold their hand, either. Just speak shortly. It takes less time to Type "Press B" than "omfg how do you not know how to press b u fkin noob uninstall" It's also considerably less rude, and you don't have to deal with it.

Rudeness is Pretty much a Black/white Scenario. You're either being rude or you're not. Putting someone down because they're Inexperienced or just generally lacking in the Skill Dept. is Unecessary, Rude, and really toxic.

Again, in my original Response to this chain, I said "It's not your job to teach them"

If someone on your team is asking how to do a thing and you don't feel like Grabbing a Ruler, an apple and a lesson planner, then just don't respond. More than likely your teammates will inform them.

EthyreonDec 18, 201420 votes

No one wants you in any elo teemo