Yes.
I don't like frame bags for this reason, and they don't hold much. Bikepackers like them because they don't stick out.
In my experience, the most stable configuration is two panniers mounted on low riders on the front. It looks like it would be unstable, but it isn't.
Jan Heine provides an extreme example:
