Unless the battery or charger are no name knock offs the fear of fire is overblown. A good battery of a tier 1 company is not more dangerous than other electrical devices.
I have an 80 V battery lawnmower and have no issue in my wooden garage. Same for powertools or my flashlights. Electric cars are parked in garages too. It is unreasonable to think all that stuff should be charged outside.