*grumble* a 30 dollar compression plug is in the carbon Fork. I'll move up the Stem and add another spacer ASAP and that will hopefully resolve the issue. When I installed the crown race I was very careful to check it was properly pressed into the fork.
The real issue for me so far is I can't figure out how to get the fork pressed in securely so there is no room for it to move. It just keeps feeling like there's play, and I can only really find the play when I'm riding which is driving me absolutely insane.