Will we ban riders that leave their line and don't interfere with any other rider? If not, then it seems like we are penalizing only the violators that had the misfortune of having someone unknowingly come up on their side.
I'd think those in the lead sprinting all out are pretty oblivious to those rapidly coming up on their side from well behind or after having been already passed.
I'd think we'd have to be willing to disqualify any rider going outside the set limits whether it interfered with another or not. Maybe in some cases just a points, time or win disqualification and not necessarily a ban unless it was an injury to other.