Thanks dudes. I figured out a way to put the velcro strap through the battery loops to make it long enough to fit around my stem. It's not the way it's designed to attach, but it works.
I like the bottle idea, but I drink a lot of water when I ride, so that wouldn't really work for me..