[PATCH 5.0 76/95] USB: serial: f81232: fix interrupt worker not stop