This is a great example as to why advice here should be weighed.
Road bikes are typically lighter, usually more aero, handle better on pavement, and are generally geared for (wait for it) riding on the road.
You'll never bridge that gap, no matter how supple your tires.
Lower end road and lower end gravel there is probably not much difference. For nicer stuff though, it's pretty huge.