A charcoal filter helps, but my experience has been that my other filters like we use for backpacking make water safe, but don't do much for the taste.
I will say that I have toured, backpacked, and otherwise traveled across the US pretty extensively and places with really unpalatable tap water were pretty rare. I have been place where individual wells were pretty bad, but any municipal water was generally okay. Some few towns small enough to be served with everyone having individual wells were pretty bad, but again definitely an exception.
I have also heard that many places were not allowing folks access to water taps and soda fountains public restrooms were closed due to covid 19 and folks were buying way more bottled water due to lack of access to a tap.