I suspect the OP is overlooking the biggest difference of all - the motor.
A fit rider in a high gear will easily pass a weaker rider in a lower gear while not appearing to be working nearly as hard.
__________________
My greatest fear is all of my kids standing around my coffin and talking about "how sensible" dad was.