When I was trying to bump up my fitness I tried really hard to improve my average speed on the bike computer, and my time around a 12 mile lake loop. I suppose today I’d be using a power meter. Health issues slowed me down and I quit “training” per se.
I was always improving by a few seconds at a time but the only sudden quantum leap like you desire came with a road bike... a very racy one.