From the perspective of you doing it, don't, it is not polite.
From the perspective of it being done to you, they likely don't know, be polite and say hello.
that being said, I've been in pretty serious discussions and had the hanger-on jump in. I was not so kind and let them know it was rude.