I think you'll get used to the quicker handling, but if you want to increase stability, a longer stem, wider handlebars, and/or bigger heavier tires will increase stability, but they all have potential drawbacks.
I'd ride it a month or 2 before making any changes, see if you get used to the current handling.