It would be time for a new bike if someone offered me that Felt.
I think you're ready. You've proved to yourself that you'll get several years of use out of a nice bike, and that you know what improvements you want.
My only advice is, sounds like your Felt is at the limit of adjustment. I'd suggest choosing a bike that not only fits better, but can be adjusted
beyond what you need right now, i.e., without having to max out any of the adjustments. Also, bring a yardstick with you to the bike shop and make sure you believe that the new bike's geometry is really different than the old.