I sweat no matter how low the temperature gets. I'm going into my fifth winter of riding now and have found over the years that all I really need on top is a long-sleeved base layer (I usually wear SmartWool) and my Marmot windbreaker. As others have pointed out, I guess you could throw something extra in your pack for when you catch a flat.