Anybody worth half a squirrels poop will admire you for doing something that is difficult for you. Anybody else doesn't matter.
If the speed of sound riders give you a hard time, challenge them to a race.. but to make it even strap 200 pounds of potatoes on their bike.. with an evening handicap I bet you'd win! You are already used to the weight!