You just have to face the fact that your phones GPS will face some challenges because of the way it's implemented in the phone. Along with how and when it establishes and shares your location. My wife and I have been sharing location with each other for over a dozen years now. And all of our phones have been subject to reporting my or my wife's location in the wrong place occasionally.
Perhaps ensuring that the apps you are using for this have permission to use your GPS whenever they want might help with some false reports.