Your XT brake levers could have a lever travel adjustment - a knob or similar that can adjust the lever position and movement (travel)
you can see the knob ( 'A' ) on the older XT levers in the top picture ( 'B' is a rubber cover )
and also on a bike in the bottom picture (easier to spot the knob on right lever against the background of the white garage door)