If each bike is set up to work with that same wheel set, swaps should be very smooth.
Main drawback I see is that if you have two bikes, wouldn’t you like to have them set up for different purposes? Or at least slightly different? And if that is the case, would it also not be preferable to run different tires? And if you need to swap tires, it defeats the purpose of having being able to easy swap.