[PATCH] spi: Fix unregistration of controller with fixed SPI bus number