There will be visible flex in the tire, but as long as you don't feel the rim hit the ground when you hit a bump then you are not under-inflated.
I ride 700X32 tires and keep them between 80 and 95 psi and I weigh 240 lbs, so your 38 mm tires at 80 psi should be fine.