I think hybrids have their place. My local shop does several "community" oriented rides (breakfast ride, farmer's market, ice cream, etc) that are intended to be relaxing, easy-going, family rides. My wife and I both take our hybrids (mine with a trailer for my 2 year old) on these rides. In fact, I have take my road bike once, and it was not fun. The pace is too slow and feel too laid back to really enjoy the ride with a road bike. I don't think I am alone in this. All of the regulars on these rides ride something that is not a road bike (though we all own them), mostly hybrids, but some MTBs, a C&V, and a CX. The people who show up in road bikes usually only go once, and if they come back it's usually on something else.
Perhaps a CX bike would suit me just as well, but for the cost and comfort, I find my hybrid to be perfect for going out with my wife and son.