Bad jokes aside, if races can be won by a thousandth of a second I'd say its worth it. But I'm sure its mostly cosmetic. Even so, imagine a swimmer with hair on his back and legs.
At least 50 % of the audience would instantly go eeyuh and tune out. In these days of media coverage, that's the last thing sponsors want when more viewership equals more profit.