There's a reason that just about nobody outside of the US uses road bikes for transportation and instead mostly ride upright Dutch geometry. As you pointed out, the overall time diff is often between zero and negligible. Even on my 9 mile each way commute the difference is 5 minutes ride time (though road or mountain then require considerable more time getting ready at each end).
MAMIL culture is largely limited to a US phenomenon for a reason.