[PATCH 5.10 643/717] spi: atmel-quadspi: Fix use-after-free on unbind