I have a Streamliner rack. It's light and easy to remove. Axiom makes bags from small to large that are a 10 second remove/install with their system.
The forward rack brace does attach at the caliper mount. I wasn't really keen about messing with the carbon part taking the rack off and on, let alone messing a bit with the caliper to get the brakes right again. I used a seatpost clamp with ears and made a different bracket that hangs from there. Two 5mm bolts and the skewer is all that required to get the rack off and on. I'm thinking about making slots out of the holes that the skewer goes through. Then it would just be a matter of loosening and readjusting the QR. Even easier.
My trailer is 13lb and pulls great. But, the Streamliner with a medium bag should be less than five pounds and easier to live with for motel to motel hopping.