Wind chill certainly does factor in. Even layered up, the wind takes heat away. Yes, even more so than moving on the bike. I can certainly tell the difference between -15c with no wind, and -15c with even a slight breeze. My Raynaud's reminds me even if I don't notice it right away.