An attacker only has to get lucky once, so while I do put SSH on a non-default port too, it's not enough to avoid attacks on its own.

I mostly do it to quiet down the noise from the non-stop bots and scanners.

Being off the IPv4 space completely can be even more effective at that, FWIW, but that can have other issues. Only feasible for some!