I think the fifth series is a big improvement on the fourth, FWIW. I almost didn’t watch it but now I’m glad I did. It still had some REALLY dumb parts but there were also a few really emotional episodes that I felt made it worth my time.
If you don’t feel up to finishing S4 and S5, I still recommend episodes 2 and 4 of S5 if you want some heartwearming Rudy-centric drama. :D