Definitely I'd say do the fit calculator to find out the right size for sure. I know for me (although im a guy) the bike i was fitted with originally a SE Draft Lite 49cm was okay on the height, however due to my weirdly long torso, it ended up causing backpains from leaning over for so long, as well as on my kilo tt. My new bike is better fitted for me at 51cm (still slightly small, i would ideally fit a 53 but my short legs say otherwise). A fit calculator will definitely help since you said you wanted to go into drops you should make sure the top tube is the right length so your back isn't scrunched/bent in some way that will cause pain during and after you ride. But you could compensate that with a long stem but I've yet to see one past 120mm.
Do a fit calculator, it'll take you probably 10 minutes if you do it by yourself, less with a helper.