I did, until I pulled a groin at the beginning of a bike tour and spent the next two days only getting off the bike at lunch and dinner because I was unable to get my leg up and over
But yeah, I generally prefer a bit bigger bike than recommended. Especially so, as I have a long torso, anything that is for "my height" leaves me a bit cramped up top.