My fat bike (with Vee Mission Command 4.0" tires) is 20% slower on pavement than my cyclocross bike with touring tires.
If you want to own a fat bike and ride it on pavement, you should get a second wheelset with 29 x 1.5-2.3" tires that'd be much faster.