IMO it kind of depends on where you live to define extreme. Where I live we rarely see 100F but often see below zero cold.
My experience here is that the cold is slower. Wearing more layers of less than aero clothing, as well as the mentioned breathing cold air, and riding an upright style bike more often. Below zero I'm not riding a bike I'm walking.