[PATCH 5.4 238/434] spi: img-spfi: fix potential double release