[PATCH 5.4 153/282] spmi: Add a check for remove callback when removing a SPMI driver