I think it depends on how much time you're actually spending on the bike. If the bike is transportation to other things that involve a lot of walking, like a commute to work, wear shoes that work better for walking. Or carry a spare pair of shoes.
If you're dealing with foot pain issues, that's another issue.
You can stiffen up the soles of softer shoes with rigid inserts like Super Feet.