I am similar in size .... it is possible that when you hit hard bumps the ends of the spokes stick far enough into the rim tape to stress the tubes. That is a lot of force to drop on a tiny metal stick ..... only alternatives would be something stuck in the rim tape (tire wires can get anywhere and hide really well) or ... you are pinching the tubes with a tire lever when installing them ...
or something else entirely.