1 mm is fine, from a practical standpoint.
Imagine you were to take a straight edge or a ruler and lay it along your normal riding surface, how flat do you think it'd prove to be?
Not much point to try for an absolutely perfect wheel when it's going to roll on an undulating surface.