While I agree with the above, I'll add a note about riding technique that will go a long way towards making your rides more comfortable. Without seeing how you ride, I suspect that you "ride heavy" in the saddle and your arms are probably stiff. Try to hover over the saddle instead of sitting on it. It's called a saddle for a reason in that it supports you but it isn't a "seat" for sitting on. If the saddle is bearing all of your weight, it's going to drive right up your spine and make you very uncomfortable.
For the handlebars, relax your grip and bend your arms. Let your arms (and legs) flex as you ride over bumps and holes in the road. You want a light grip on the handlebars and you don't want your elbows locked straight. Your elbows should have a similar angle to what you use on a steering wheel but instead of being at the 4 and 8 o'clock position, your elbows should be at about the 3 and 9 position.
Finally, if you see the bump coming or it's a big bump, put your feet parallel to the ground and lift up slightly with your legs while you coast over the bump. Your arms and legs should flex as you go over the bump letting the bike come up towards you. Physics will keep you...or, more technically, your center of gravity....moving in a straight line. If your arms and legs are rigid, your CG will go up as you go over the bump and down afterwards. If you allow your arms and legs are flexed, the bike will rise towards your CG but your CG will continue in the same line.