Gyozadude, trust a home shop machinist to over complicate the solution. And I say that with affinity and a smile since I'm one of "them" and have been known to similarly overthink solutions from time to time...
There's really no point in making and including such a part when either simply ignoring the issue or at most adding a padded soft washer punched from some fiber reinforced rubber sheet is all that is required.