If you just started, then it will take time to build up your stamina and strength. Speed is an ever-changing thing depending on the road, the rider's condition, how much sleep you got, how you ate. As you rack up the training miles you change a lot, might have to change the bike setup to suit the newer you, and then change it again in the spring. It is nice to have other riders around to try and catch, that is a good training tool. Some you will catch, some you won't, that is just probability.