the biggest thing I found is if your using wireless data it will never work, you almost have to be on a wifi for it to work as you in game controls. I found if I am using the app it HAS to be on wifi. After I figured this out it works flawless for me.
but your issue sounds more in-depth though.