I would also check to see if there is any odd issues with the caliper. If you're running fixed or have a rear brake, maybe remove the front brake temporarily and attach the rack without it. Just to eliminate another variable while testing. But like Mumonkan said, it could just be extra weight on the fork that's making it torque left a little.