I usually leave the little plastic caps on, but don't worry if they get lost.
I do like to throw a Presta/Schrader adapter on in place of one of the caps, but don't put a cap over the adapter.
The nuts are handy to hold the valve in place when attaching the pump, especially if one has short valve stems.