When you say switchbacks, are you referring to twisty singletrack? If so, maybe an MTB is in order. 2 bikes for different styles of riding.
To be clear, my gravel bike is ridden on our flat river bottom twisty singletrack too as its plenty of tire and handling is quicker which I like. Im not knocking how you use the bike.