That was my first thought also, cardiac drift, but OP sounds like he's got more going on than just that. Heat, hydration, lowered oxygen in his area if ventilation isn't strong enough, something like that. It could also be a matter of conditioning though.
I would want to compare indoors with an outdoors ride at the same effort and duration, to possibly eliminate some of the variables.