If you are storing it for long term the battery will be dead and will need replacing anyway.yes i am storing it long term for years but if it doesn't leak i would keep it on the pcb and not open the devices but i don't know if it leaks or not
Remove the battery now.