A big factor is the steepness of the grade, for every one percent increase in steepness there has gotta be a huge increase in exertion for the cyclists. For illustration, just watch the TdF when the riders are in the mountains. You got the healthiest cyclists in the world with fat, drunken fools running beside them and sometimes those drunk fools even give the cyclist a push.
