As a driver exiting and entering a driveway, you are not expecting a cyclist at 15 mph closing distance fast and often visually impaired by vehicles and trees.
Certainly some streets are to be avoided, however, do not convince yourself sidewalks are a safe haven.