Make your own panniers. Check online for instructional pages on making kitty liter bucket panniers. You can get the buckets at the local dump and reuse them for some useful, like bike touring.
Keep using the kitty liters and ride longer. Why improved on something that works. Instead use something that works and save the money and ride further.