1. Bottom bracket height. Unless you ride with 200mm crank arms, its too high for pavement use.
2. Fork length, weight, offset (again, not for pavement)
3. Tires.. obviously
4. Head tube angle. Slack for stability on rougher terrain.
If you replaced the fork with something rigid and suspension corrected, and replaced the tires with something more pavement friendly, in the same diameter/size, it would work fine for your needs.