I carry my cell phone in an OtterBox case attached to my belt when I'm commuting, unless the weather is bad enough to cause me to wear wind/rain-proof pants. In that case the phone is in my backpack.
The OtterBox is virtually bullet-proof,and impossible to come off my belt unintentionally. On recreational rides, I carry the phone in a rack "trunk".