We have some large groups that ride the roads where I live and it can be hard to pass them. Worst case was pulling out of my driveway right behind a group that I was stuck behind for the 3.5 miles to the main highway. But it only added a couple minutes to the trip. Usually you're not behind them for more than a mile or so. The roads belong to everyone and sometimes you just have to grin and bear it.