Use "Seal 'N Peel" made by DAP and carried by all hardware stores and even Amazon.
I seal the gaps around my air conditioners and it peels right off when you want it to. Only problem is it comes in a caulking tube - but you CAN preserve the unused portion of you seal up the nozzle carefully.