I use a tool I got on Ebay that looks like a super thin "pickle fork" for removing ball joints. It's a wedge you could almost shave with it and it does a beautiful job. No scratching and it doesn't damage the race. I use a rawhide mallet with it and so far it hasn't taken much force.
__________________
".....distasteful and easily triggered."