Everyone is on their phones.
On one of my morning rides (rush hour) as I pull up or slow down for a red light I'd say that about 80% of the people I glide by are using their phones. It's inevitable.
But to answer your question... yes, I have confronted a driver before. I'm usually not too happy with myself after it's over but it is what it is.