I have had this shifting problem. Sluggish shifting to smaller cog on the rear. It was the grease that Shimano and Jagwire put into the cable housing before shipping.
When I pushed the cable through a big glob of grease came out. I cleaned it out with Breakfree CLP which is safe for plastic.