Not suif this has been mentioned, but when you go to a narrower bar, this pushes your torso up...so you need a longer TT and/or stem to compensate.
I ride a 58cm road bike 61cm track bike for this reason. The bars are narrower on the latter.
Just adding more stem could affect handling. Sometimes more TT is what’s best.