[PATCH 5.17 080/298] spi: fsi: Fix spurious timeout