[PATCH 6.14 62/73] spi: spi-sun4i: fix early activation