[PATCH v2] memstick: Fix deadlock by moving removing flag earlier