I've just finished a month and over 600 miles with a set of Silca latex tubes, smooth plastic valve stems, no problems. I mostly use a floor pump with clamp on head, but have used a mini pump with threaded chuck. Both work fine.
I suppose it's possible that over time the action of repeatedly popping off a clamp-on chuck might stress the valve stem base. But if that happened I'd also check the valve stem hole in the rim to be sure it doesn't have a burr that damages the tube. That has happened on my other bike with butyl tubes -- the burred rim hole nicked the base of the tube, possibly worsened by the action of yanking off the clamp-on chuck.
But the Silca latex Presta tubes with smooth plastic valve stems don't resist popping off the clamp on chuck so I'm not too worried.