Thanks for the replies. I do alternate pressure on the brakes. But it's still gets tiring. Mostly on wet days or really long/steep descents.
If the larger rotors don't help enough I think I'll break down and buy a new group set. I'd hate to keep throwing money at it and never be satisfied. Maybe i can build my kids next bike with the advent x take offs if i go that route.