It could be how you are warming up perhaps? Are you mixing in some efforts? Kinda like how if you do a structured FTP test, it has you mixing up the intensity and duration to get your heart pumping? I would imagine if you are going at the same low intensity pace all the time, that it will take a long time to warm up.