As I read the latest research and advice, it all counts. OTOH, if it takes you 4 minutes to ride to the bank, you probably only get 2 minutes of elevated heart rate, so that's half as much "exercise" time as you might think.
If everything is within a mile, have you considered walking rather than biking? Weight-bearing exercise, more time with elevated heart rate.