The people suggesting a fatter tire are offering good advice, because when you hit a pothole, the sequence of failure is: tube --> tire --> rim.
In other words, first you'll pinch flat. If it's worse than that, it might cut your tire or flat a tubeless tire. If it's worse than that, it might crack or dent your rim.
If it's worse than that, it might throw you over the bars after damaging your front wheel. But your fork will still probably be fine.
If you've ridden the route and are getting by with your current tires, there's no reason to worry about the rest. They're the canaries in the coal mine.