Carry along a fire hydrant wrench.
Seriously though, I used to carry a water key for getting water out of faucets typically seen behind strip malls and businesses that have the handle removed to prevent mischief.
Public water fountains? Too gross for me, and almost always lacking adequate water pressure.