In the nicer 3 seasons, I like to travel as light as possible. But in winter, I resign myself to keeping a pannier on my bike with a few options for clothing (lighter or heavier gloves, balaklava, extra shirt), or if for no other reason, a place to put excess clothing if the day turns warmer than expected.
Because even after more than a decade at it... you never know for sure.