I was a fanatical rock climber through my late teens in to my early 30's. I did it all from 4 day Big Walls like El Capitan to Sport Climbs and bouldering trips to Hueco..
Now I just take my daughter to the climbing gym. It's not a great compliment to track training- but it doesn't seem to really negatively affect it since its totally different muscle groups.
Typically I'll only climb if we go to the gym on a Sunday- my only day off the bike.