Purely empirically, with no data or theory behind it:
Small differences in stem length don't have much effect on handling. If you've got to use a really short or really long stem to make the bike fit, it's likely to handle weird. Also, different people like their bikes to handle differently. Personal preferences matter a lot.
--Shannon