If you're trying to remove this type of pad:
I would cut the remaining pad off flush with the holder, then stick a small screwdriver behind the remainder from the open end and pop it out. It should flex enough to come loose when the rest of the pad isn't there to stiffen it.