Ya, I'd keep riding, and do some focused interval workouts. When I began riding I tried racing after about 6 months, I had just gotten used to clipless pedals, could hold down 17mph solo, and had recently completed an 8hr century. I got dropped and lapped so quickly my mind was blown. It wasn't until 2 years later and very specific training that I was able push the pace in races and A-rides (and have confidence that I won't be dropped), while using the same bike.
My recommendation if you want greater speed and power is to get a powermeter and follow guided, zone based, training.