Just buy any number of wedge bags that don't move.
Plenty are available that dont use a seatpost attachment too.
An easy and inexpensice one that never needs to be touched is Speedsleev. It comes in multiple sizes, is dead simple to attach, and it doesnt sway.