If it were me, I'd take it into a qualified shop and have them look at it. You'll get a bunch of opinions on the internet that may or may not be right, but without seeing it in person I have no idea how anyone could determine if it's a potential concern or not.
I wouldn't take a chance on a steerer and now feel the need to pull my bike apart and inspect mine.