[PATCH 6.1 138/217] net: sfp: Always call `sfp_sm_mod_remove()` on remove