Everything in moderation...even moderation!
In the winter with poor weather it makes sense to take an afternoon off work and ride when it's a bit warmer and sunny
If you're trying to log summer hours in the winter, you're overdoing it. Or you live in Cali
Try weightlifting in the winter to mix it up. And hiking. You'll get your fix and be stronger on the bike in the spring