Housing and derailleur hanger are the likely culprits. I have the hanger alignment tool and it really only takes a few minutes. I've used it on a few bikes where I've helped people out and they are always amazed at how much better it works. When you consider that 10/11/12 speed setups have such tight tolerances it is no wonder that a bent derailleur hanger messes it all up.