It's hard to unplug the battery!
It is a tight fit - but you don't have to worry too much about pulling the wires loose. We have not seen this happen to the XT60 connector. As of this writing, it has only been reported twice involving the connectors seen below as JST-XHR-4P & 5P that attached to the charger in all the thousands of batteries sold.
Leaving the LiPo battery plugged into the main drive unit when not in use is not recommended. The battery may continue to drain - and if the voltage drops below the minimum voltage this will permanently damage the battery. This would not be covered under warranty, so to protect your investment ALWAYS disconnect the battery plug from the drive when not in use.
Always charge the battery inside a fireproof container such as a battery charging bag