Boards›Live Incident Breakdown

The Good, The Bad, and the League: 2/21 - 2/27

Couch Commando·2/28/2019, 9:24:24 PM·6 votes·56,140 views

Your weekly dose of server problem-os, NA League news, and other!

Most splits are half over, the Summoner’s Crown Capsule is available through Twitch Prime if you want some free loot, and we all learned that Sylas can channel his inner demon by stealing Teemo’s ult...truly the stuff of nightmares to worry about shrooms on both teams.

ALSO, we would like your help in choosing the next Tristana skin! Head over to here after checking out this week’s GBL (or before, DON’T LET ME TELL YOU WHAT TO DO) and place your vote on the skin you'd like to see in game next for Tristana!

Lot of problems this week, so strap yourself in. It’s gonna be a bumpy ride.

Follow-Ups:

None

**Server Stuff: **

  • Friend List Disconnections after Patch 9.4 (2/20, ~32 hours) Patch 9.4 rolled out world-wide with some new updates to the clubs code and backend, but also with players constantly connecting and disconnecting from chat after various client processes happen. Fiddling with club toggles didn’t fix it, and repro steps eventually narrow down that the issue stems from logging into League at 9.3 and updating to 9.4. A server-side redeploy ensured anyone updating from 9.3 to 9.4 wouldn’t be disconnected from chat constantly. NA only experienced this for 15 hours, but some regions had it for 32.

  • Clubs disabled due to service bug (2/21, ~15 hours) Patch 9.4 rolled out, and due to the problem noticed above with the chat system, one of the diagnosing steps required disabling Clubs. On all regions still patching or that hadn’t deployed 9.4, disabling Clubs prevented the friend list issue until the server re-deploy could roll out. Preemptive disabling prevented player pain from chat systems, but also caused it by being unable to modify club content for the duration of the bug.

  • An API instance slowed down (2/21, ~44 minutes) Nasus applied wither to one Riot API instance, causing delays to the end of game screen, as well as viewing match history within the client or on the website. Investigation showed it was a higher than expected load, so additional server hosts were spun up to deal with the increased load. Once load returned to expected levels, the additional server hosts were spun back down and retasked.

  • Emote Loadout Saving Issues (2/21, ~108 minutes) A change list item to a backend update caused delays and issues with one particular part and process on the client. Refreshing various processes to generate new player tokens fixed the emote issue! Yay for non-specifics! *

  • MrCash/Yandex/Paypal unavailable (2/21, ~33 hours) Updates to Chromium caused issues with properly sized and font issues, preventing proper purchasing. Adjusting the client font rendering values corrected the issue and the affected services were enabled again.

  • Loot backend spike causes slowdown for players using Store and Loot (2/24, ~107 minutes) Error rates for redeeming Loot reach suspiciously high levels. Investigation shows an excessively high amount of logs on a process server instead of properly stored in a DB somewhere safe, under guard by top men. Removing the already backed up logs, and giving enough time for the past Loot to redeem reduced error rates back to acceptable levels. Those logs remain safe in a warehouse somewhere, hidden in a crate…

  • RP Button returning errors (2/25, ~37 minutes) The store was updated with a new feature, which had an incorrect config file associated with it. The incorrect config file caused RP purchasing to fail. Redeploying the config file fixed the issue, and RP purchases worked properly again.

  • **Players delayed or unable to login (2/26, ~27 minutes) **A monitoring test ended not quite as expected. An accidental change was made to an automated health-check system, which would automatically scale down login servers during issues (instead of scaling up). The change propagated into the primary systems, and when the automated health-check system noticed issues, started scaling down login servers, which caused the system to notice, which caused it to scale down...you can get the picture. Removing the accidental change fixed the system.

**Game Stuff: **

  • Changes to Anti-Cheat raise game reconnects (2/22, ~10 hours) An ISP maintenance is suspected for heightened game reconnects, but as the change-list for the ISP maintenance finished, reconnects remained at heightened levels. Investigation proceeds to look at an update to Anti-Cheat, but the actual update isn’t causing additional reconnections. Instead, a feature not-intended to be run was the problem. Said feature was disabled, and reconnects fell back to expected values.

Player Support Issues:

There is a known issue where attack move doesn’t work properly on some champions since 9.4 rolled out! This is a known issue, so if you suddenly are sure that you might be having issues with Zilean, Talon, GP, or Renekton, it might be because of this!

If you are seeing Login Issues and are on Windows 7 Escrow Build, you might want to swap to a non-Escrow build, we’re seeing issues around “We’re unable to log you in because you may be offline.” as a result of the Escrow Build!

Morgageddon & Couch Commando

31 Comments

Karunamon2/28/2019, 9:37:07 PM5 votes

I've never heard the term "escrow build" before. What is that?

Also, I love these. Getting a feel for the kind of problems you run into operating at the kind of insane scale that Riot does is pretty enlightening stuff :D

RiotRiot Morgageddon3/1/2019, 2:02:45 AM5 votes

The only thing I can say, is that the feedback about positional matchmaking/ranking/placements hasn't gone unnoticed from the people who are qualified to talk about it!

And that's all I have to say about that.

Kürama3/1/2019, 1:50:38 AM3 votes

Thanks for letting us know!!

Also the "All of the above" option is missing from your poll.

The23rdGamer2/28/2019, 10:59:28 PM3 votes

I really love these and I thank anyone who takes the time not only to maintain these but to keep the public in the loop as much as you can. :)

I would love to see you go in-depth on anything and everything really, as greedy of a hope as that is. ^^;

QuiQ3/7/2019, 9:57:24 PM2 votes

Hey, I just wanted to report a small little bug I experienced last week and idek if its still there lol. But when you play Kled jungle, it doesn't give a trinket. It's the jungler item and potions for the reccomended. There's no problems but just a little thing to fix.

FairyTaleHappy3/1/2019, 8:52:17 AM2 votes

Hey Captain Furniture, I was curious about the current state of clash. Is this still being worked on behind the scenes, or is it reasonable to drop all expectations of clash coming back?

La Belle Sauvage2/28/2019, 10:05:02 PM1 votes

I really would love a deeper dive on the postional ranking, matchmaking, and how the current placements make little if any sense.

Is Riot willing to change or even roll back any parts of the above mentioned?

I'm sure I'm not the only player that has a big issue with this new system.

rikusbby3/2/2019, 3:21:32 PM1 votes

I still can't log in> I get an error message "We're unable to log you in cause you may be offline" and I'm not and I am just trying to get this fixed. :)

zPity3/5/2019, 5:16:00 PM1 votes

please explain issues with people "stuck at 100% loading" but aren't getting into the game (until /remake)

TitanCrit3/5/2019, 8:57:52 PM1 votes

When will Twisted Treeline get any sort of news updated? Or "In the works" update? People are starting to make memes about how temporary game modes are getting better service than Twisted Treeline.

NocaNoha3/5/2019, 11:35:31 PM1 votes

What is the best way to report a bug? Boards/Reddit Bug Megathread or posts/Over game client option? I saw the patch notes and noticed that some bugs are not addressed despite the fact that they were reported a week and a half or earlier on.. and are kinda unfair to play against

While I understand that some bugs are harder to fix than others.. on the other hand, I also can't be sure if the bug passed as unnoticed? So, got any suggestions?

Silly Neeko2/28/2019, 10:54:30 PM1 votes

Last I knew the "none" ban function is still missing and I was informed it was due to a bug. I do not see that in the post.

Otherwise, thank you again for keeping us up to date on the problems that are going on and what some fixes are that was, or could be done.