If you're really buying the bike to be an endurance rider or a race rider than go with the proper bike..but it sounds like you're more of a casual rider. If you're comfortable on the aero and like the look of the aero, go with the aero. It sounds like the aero bike is what you are excited about. In the end it's about personal preference. I ride an aero bike, I don't race, but I love the bike and just looking at it motivates me to ride and train. You don't want to buy the endurance bike and second guess your purchase every time you look at it. I recommend you buy the bike you're passionate about.