Generally west and south of town are the more interesting roads and trails. But Madison is small enough that you can easily stay on the east side and still get to the west/south from there -- the Capital City and SW Trail go straight across town. The east side of Madison is more interesting in terms of food; west is more residential/suburban.