I have to say both partially at fault. Mainly the U-turn rider for not announcing that he was slowing and not looking behind him before making his maneuver, and the OP for not signalling with a bell or announcing passing. But I have to give the guy making the U-turn most of the blame for not making sure he could make his U-turn safely.