UDP is designed to be ‘unreliable’ in the sense that dropouts happen occasionally and apps and servers are expected to deal with it.
If you have a 5G connection and phone you can at least rule out the home network by running the next race on a 5G hotspot from your phone. Since Zwift mostly runs locally the amount of data isn’t much, 30-35Mb/hour something like that.