I've thought the same, and decided no.
BB drop is a big issue. And, really, really make sure you have width all around the tire - brake bridge, chain stay, front derailer...
I do ride 32 and 38mm tires (ramblers). The difference is significant to me. but in the end, I got a bike that can comfortably take both sizes.