I recently switched my 23mm Fortezzas back to 25mm Conti 4000's for a metric century on crap roads (lots of loose gravel, pot-holes, chip-and-seal), and was extremely glad I did. I would likely have gone down on the section of recently chip-and-sealed county roads if I had the narrower tires.
i had one ride with the Continentals on normal roads after the metric, and could not get them off soon enough... I just feel like I am trying to drive a tank on a stock car track when I get out with the guys on a team ride. For me, comfort is just not the highest priority when trying to finish a ride at a decent average speed