Oh, sure, if I have the visibility, I probably won't stop in practice unless I see potential danger from another user of the road.
Not everybody is wise to trust hearing. I need hearing aids, for example, and I don't wear them while riding (because I fear I'll lose one or both). also, a helmet can screw sounds up.
But if one is truly afraid of being hit, the safest course is probably to stop.