[PATCH 5.4 510/658] ipmi: fix long wait in unload when IPMI disconnect