I ride with toe clips and straps but no cleat. A number of years ago I picked up some smooth rubber soled semi-rigid touring shoes.
I keep the straps just loose enough to get my shoe out but not so loose that the shoe, with velcro straps, easily slips.
John