I'm 68 and didn't start riding until I gave up running 7 years ago following a hip replacement. Last year to supplement my riding (2,500 miles/yr) I tried Spin Classes and was surprised at how much they helped me.
Between that and some relatively easy strength conditioning exercises at the gym I've kept or slightly increased my stamina each year. Like others have said will just keep riding as long as I can.