Also look on the sides of public buildings, churches, etc. Many have faucets.
In desolate areas, when desperate, I've gone up to houses and asked if I can use the outside faucet. No one has ever refused me.
Also: consider buying a Camelbak or similar hydration system.