Fortunately my kids (2) were born only 15 months apart, so I only had to give up cycling (and skiing) for about 3 years until they were old enough that they did not need quite as much attention. Riding in the early morning wasn't an option, since I was responsible for burping after feeding (mom went back to sleep), and even after they were weaned they were early risers (between 5 and 5:30 almost every morning).
I did get some time on the Nordictrack for those three-ish years, but at that time my family (and work, of course) were my priorities so I got structured exercise maybe 1 - 3x (max.)/week.
Honestly, I was so busy I didn't miss it much. Those 3-ish years flew by pretty quickly. No regrets.