I also consider adding a gravel bike to the herd but I have trouble justifying spending a good chunk of change for a bike that'll make me slower, I'll take higher speed on smooth pavement over slower speeds on bumps.
when I was bike shopping I checked out an aero bike vs a race bike and in my particular situation I found the aero bike to be a lot lower on the front end. For me that sealed the deal for the race bike. that was canyon though, other brands may have more similar fits between race and aero
Could also just get nice wheels for the current bike, but that's not nearly as fun as a whole new bike