You're making a lot of assumptions without actually going to the source for the real reasons. I can't speak about your locale or the riders you have observed, but there are various possible reasons to avoid cycling infrastructure. Some "protected" bike lanes hide riders from the view of drivers, putting them at risk at every intersection and driveway. Some bike paths are overcrowded, often with non-cyclists (walkers, runners, dogs, etc.). Some bike lanes are in door zones. As for someone who teases you for making your own decisions for your own reasons, without at least giving a logical argument, they're obviously not worth your time.
__________________
It's like riding a bicycle