There is a wealth of bike lighting ion the market. Most are rechargeable via USB and stay bright for quite a while ... and many are easy to get on and off.
I use Light and Motion Urban lights up front, because they are light, compact, bright, and attach with a simple rubber strap. Plenty of others just as good. Mountain bikers are known for truly massive light arrays, with on-bike power packs and such, but a couple portable, easily removable headlights and one good helmet light (I assume you would take your helmet with you) should meet your needs.