I've come to realize that YouTube suggestions are rather shit (I'm late to the party, I know) and the side bar where they live kinda sucks to be honest.
What I found out that just blocking the side bar actually makes the UX a lot better for me. I get just the video I want to watch, without the algorithm pushing me whatever the fuck it tries to push me. Sure this also removes the ability to discover what I might like to watch next, but... it's not really a bad thing now is it?
So just by adding this small filter to my uBlock Origin custom filters, I can now just watch the video I wanted to watch without the content that I did not come to watch trying to push themselves to my eyeballs.
Here's the filter to add:
'www.youtube.com###secondary'
So far I haven't found any downsides. This doesn't remove the "watch next" suggestions from the video player after the video is done of course, but that's fine, those are not there constantly so I can live with those.
And I know there's probably some site one can go to to view YouTube without other junk as well. That's fine, this isn't about those though, so no need to start listing them, thanks.