Filtering is a situational call. In a situation like that, it's really just a question of how many cars are going to be behind you until it's safe for them to pass. Somebody is going to be unhappy with you being there no matter whether you filter up or don't.
Riding on a double yellow line between trafficked lanes is ridiculous,