Thanks for the replies everyone. I'll get the tyres and if it's too hard to live with swapping them over then in time will buy a second wheelset.
As to the question about how frequently. I have no gravel near me so it will just be the very occasional gravel ride, once or twice a month.