@Riot Why Are Some Balance Changes Not Tested On PBE?
Like Yasuo's passive nerf. The very small shield buff was tested on PBE, but the more important early game nerf wasn't. What's the thought process behind this?
Like Yasuo's passive nerf. The very small shield buff was tested on PBE, but the more important early game nerf wasn't. What's the thought process behind this?
Riot doesn't listen to PBE feedback anyways, so it doesn't matter. If they did, patch 4.13 would've never have reached Live.
The reduction to how quickly Yasuo generates Flow early/mid game went onto the PBE at the same time the buff to the shield strength was put there. The goal of those two changes was to make Yasuo's shield a bit more powerful (early game particularly) when it's up, with larger windows of downtime in exchange. Trying to just burn through the shield's more costly, so Yasuo's got more capability to make aggressive plays while it's ready. At the same time his enemies have more time with it down to try and attack him, increasing the importance of playing around his passive for both sides.
I don't think you answered his question.
He's asking why some balance changes don't appear on the PBE before going live.
Internal testing.
Didn't he just say the change WAS put on the PBE?
It was put on the pbe they just didn't tell you that it was.
Well, what he said is that it was put on the PBE. The reason we didn't notice it is because all of our PBE notes come from datamining, not from Riot, so it's pretty easy for slightly odd changes to get missed.
I think it's strange they don't tell us what they're testing.
If we knew what the feature was, wouldn't it become easier to test it?
Would it be easier to test it? Things such as our play experience and bug detection probably might not much based on our knowledge of these specific changes, and those are arguably the most important pieces of data.
I do agree with you that it would probably be better if we had a full list of what we were testing (at the very least, it would make it clearer what intentions Riot has for a patch before the patch comes out) but I'm not sure how much better the testing data itself would be.
Most bugs are tested directly. Often, the developer can have a debug system that lets mechanics, scripts, progression, and other essential game elements be tested as quickly and as intensively as possible to uncover issues that occur.
But this is not the type of game that can be intensively tested, so they have a large testing population that does it for them over the course of the games played. It would be significantly easier to know what to look for instead of having to find it on your own.
A few of you mentioned this, but the PBE isn't great for robust balance testing. We just don't get the participation that we do on live. Players may try out changes and your feedback and predictions on how things will work is still really valuable, but we just don't even get a fraction of the quality games we will get when a change goes live.
We do a lot of internal testing and we do listen to PBE concerns but we also just try to react quickly when a change goes live that is dramatically overtuned or undertuned. I'm also skeptical that we could come up with some kind of motivation or reward to get players to take PBE balance seriously that wouldn't incentivize weird behavior. PBE is great for functional testing, finding bugs and the like. It's great for first impressions, look and feel feedback, and exposing early concerns.
Unless it's a rework. The people running it tends to ignore most of the 'I don't like how this changes the champion I play' and just resolve to fix it with numbers later on.
Problem is Riot rarely reacts to even those first impression reports either.
And when an issue hits live it takes several patches until an adjustment follows up.
A few of you mentioned this, but the PBE isn't great for robust balance testing. **We just don't get the participation that we do on live. **Players may try out changes and your feedback and predictions on how things will work is still really valuable, but we just don't even get a fraction of the quality games we will get when a change goes live.
Maybe increasing the people allow to have a PBE account would help...?
We do a lot of internal testing and we do listen to PBE concerns but we also just try to react quickly when a change goes live that is dramatically overtuned or undertuned. I'm also skeptical that we could come up with some kind of motivation or reward to get players to take PBE balance seriously that wouldn't incentivize weird behavior. PBE is great for functional testing, finding bugs and the like. It's great for first impressions, look and feel feedback, and exposing early concerns.
Could the reason players don't take PBE balance seriously be duo to a lot of advice I see there ignored? (ie, players saying how it was almost impossible to land Veigar W with the E delay, and there are changes to it months later...)
A few of you mentioned this, but the PBE isn't great for robust balance testing. We just don't get the participation that we do on live. Players may try out changes and your feedback and predictions on how things will work is still really valuable, but we just don't even get a fraction of the quality games we will get when a change goes live.
We do a lot of internal testing and we do listen to PBE concerns but we also just try to react quickly when a change goes live that is dramatically overtuned or undertuned. I'm also skeptical that we could come up with some kind of motivation or reward to get players to take PBE balance seriously that wouldn't incentivize weird behavior. PBE is great for functional testing, finding bugs and the like. It's great for first impressions, look and feel feedback, and exposing early concerns.
idk why this is getting downvoted when you consider how small the PBE playerbase is and then you have to subtract those people that just use PBE as a way to get free stuff and then you have to remember the fact that MMR is fresh for each PBE account so a lot of players won't get an accurate test if they're playing vs. what would be a pre-30/low elo while being of two or more* ranks above their opponent themselves.
PBE is to make sure things are stable for release. They have an internal balance team, testers
PBE is mainly for last-minute bug-finding. For balance, Riot generally relies on internal testing.
because ballance is not tested on pbe
I'm just curious why the balance team does this. Simplicity? Are certain changes not worth testing on PBE, or...?
In general, most Riot employees just don't care about the playerbase or the feedback and suggestions we give them. They have a god-complex that makes them think they're above us and many players tend to worship them, which just fuels that fire even further.
Even if a change is unanimously opposed by players and PBE-testers alike, they will still force it to Live regardless. So long as that champ isn't part of Riot's current roster of #LC$BIGPLAY$ champions, like Lee Sin was. He had a complete and viable rework already finished, but was scrapped because of "community backlash."
Are you an idiot?
Are you an idiot?
You read that whole post and couldn't tell?
Point taken
And this is why Riot doesn't listen to some people.
More likely, they were on the PBE but they just weren't datamined. It's worth remembering that our PBE patch notes come entirely from datamining, not from anything Riot releases, and datamining has a hard time detection certain changes. Certain things are very likely to go undocumented until Riot releases the actual full patch notes.
Chances are that those changes were on the PBE, but not discovered by the dataminers...
Chances are that those changes were on the PBE, but not discovered by the dataminers...
Except they did this last year too with one of his nerfs, it was never on PBE and yet they put it in a patch anyway.
They mainly use it for bug-testing and "refining" ideas.
Some of the stuff that you see on PBE never makes it to live anyways, or it takes forever for it to.
They do listen to the feedback, Soul Sickle is proof of that. It's just that many don't give feedback...
Some of the stuff that you see on PBE never makes it to live anyways, or it takes forever for it to.
That
extra regen below 50%... will we ever see it?
Why not just balance more intelligently in general?
You guys push some ludicrous balance changes to live, even despite major critiques during the PBE step.
You guys treat the PBE testers like garbage for the most part, like they have no value.
PBE is to make sure changes don't crash the severs.