Unless there was a huge weight difference and the 2 bikes had the exact same geometry, fit, drivetrain and tires, I doubt weight made a 5 minute difference per hour.
You also can ride one day with the exact same bike and be 5 minutes faster just because physical fitness difference from day to day. Or just different wind.
How much each kg or minute lost is worth to you? Only you will know.