[PATCH 4.9 21/28] USB: serial: f81232: fix interrupt worker not stop