[PATCH 5.4 35/66] spi: Fix deadlock when adding SPI controllers on SPI buses