If I were in your position I would have signaled my turn, but I know that's not always an option in every situation on a bike. However, if I were the guy in the rear I would NOT have passed on the left while in the intersection, I would have anticipated you taking a left turn. I would have waited until clear of the intersection, then pass.