Well, I guess I am the one that uses larger panniers everyday. A couple of guys I work with don't use anything, a woman uses a small trunk bag and sometimes her small panniers. I always use the large panniers because I never know if I want to carry something home that night.
Usually my bags are pretty empty, but it gives me the option to stop at the grocery store or any other place where I will need the extra room.