That's part of conditioning and fit. As your bum starts to get sore, you unconsciously put more weight on your hands, so then those go numb.
I'm a dropbar guy, but in my flatbar days I couldn't go more than about 25 miles before my hands and wrists were complaining. Everybody's different.
__________________