LifePo4 are very safe and stable lithium batteries. I have read that Ryobi 40V HP are LifePo4 but cannot confirm. I always remove my standard lithium ion batteries from the charger when charged and keep them in a metal cabinet or ammo box. Overkill? Maybe but I sleep well at night.
No I would say your being sensible
My battery tools live under the steel welding bench and get recharged on the top of the welding bench with a lot of free space around them and near to the front should the worst happen .
All the other stuff like phones , computers & cameras get recharged in the laundry tub .
Very few will spontaneously combust when sitting there turned off , most of the problems occur when the charge regulating circuit fails or people use the wrong chargers .
Some batteries have the regulator built into the battery while others use regulated charging.
The big problem is really cheap ( usually Chinese ) equipment that has neither because the supplied charger is wrong for the battery .
We have had a spate ( over 100 ) e-bike failures for this reason
A battery is an explosive device ( all batteries ) as they are energy containers .
Drop a spannar on top of a flooded cell battery and see what happens after a few minutes
Lithium batteries are just a bit worse because they contain both an oxadising agent & a reducing agent separated by a thin plastic membrane .
People forget that a battery charging & discharging is a CHEMICAL REACTION so both generates heat and will be affected by heat .
This is why battery tools & cars perform poorly in cold weather .