To confirm its loose, grab the lower headset cup and rock the bike back and forth. Then garb the upper cup and repeat. If it's loose you'll feel the play.
The clicking is more than likely your headset but I've had it come from the stem as well. Check the bolts at the stem/bar and stem/steerer.
D