In many cases I consider them as essential as a helmet.
On the road, I am going fast enough that things like bugs can hit my face pretty hard, and on the trail I am often getting whacked by bushes and branches.
If I am just tooling around town, not such a big deal to go without them.