Yep, I have a 46 on my CX bike and use it for the road in winter and even my skinny ass spins out pretty quick. normally ride 50/34 around here with plenty of hills and still ride in my 50 most of the time
honestly i'd say leave it alone and ride it or get a 36 ring for 20$ to have options and a bit better shifting and keep the 34 if you go on a trip to a hillier area.