I rode a heavier steel cross bike last season as my regular road bike, but it had light weight wheels which helped greatly. The big drawback to that bike was the drivetrain. It was older and shifting just wasn’t what I expect now in my life.
My new bike beats that bike on all metrics—better weight, more aero, more efficient…but I’m really looking forward to a season with di2 105 shifting.
If the bike fits and the mechs feel good, the rest is gravy. You can fit tires appropriate to terrain and have a great day out there. A 5lb difference in weight is noticeable, but won’t ruin your day and won’t hold you back that much.