Yeah I hear you, can see it being a deal breaker for some people.
Personally it never affects me until I have to make some kind of dramatic low-speed turn and I usually just employ the "ratcheting" technique for those couple of strokes. But yeah being in a more precarious situation or simply not wanting to have to think about it are all valid.
Maybe I'll change my mind if I ever have a bad incident with it.