I find it annoying too, near pet peeve levels. To make it worse, they're often the only vehicle, and it would have been faster for everyone if they had just driven through.
Sometimes I'll get out a water bottle and turn my head away from them while drinking from it. Sometimes I'll wave them on with a scowl on my face. Probably I should find some zen way of not being frustrated about it.