Is it me or is every patch coming along with a large performance decrease in the client

No it's not you, its your computer.

not large but definitely noticeably

No its not you. They add few features and doesn't optimize it. Simple as that.

Client is more legacy written that last one as per what i encounter and see lol