My summer fingerless gloves wore out. Never replaced them. Trained, raced, crashed without them for 15 years or so without problems.
Got a new pair last year. I like being able to wipe sweat, but still ride without them sometimes.
I always wear gloves in cold weather though.