If you haven't been riding a road bike for very long, you've got a lot more speed to gain in many ways that are cheaper than spending that much just for a groupset (which is almost always more expensive than a full bike due to OEM discounts that bike manufacturers enjoy).
- Faster tires (and latex tubes if you don't convert to tubeless) to decrease rolling resistance.
- Tighter fitting clothing to reduce drag. Pretty much anything faster that puttering around or on a Cat 2+ climb, aero drag is more significant than weight, of which your body is the biggest wind blocker.
- Better position -- maybe you already have a good position as an experienced rider, but again it's all about minimizing frontal area and you can work on improving this without buying anything
- Keeping your components in good condition. Don't let your watts disappear due to friction loss, keep them clean and well lubed/waxed
- Work on your power. I guarantee that as long as your Allez wheels are true and your tires aren't flat, spending a few hundred on a powermeter and working on your engine will bring you more speed than switching to Sram Rival. Even if you're in good bike shape, chances are if you've always just ridden by feel your whole life, you haven't come close to tapping out your potential.