[PATCH 5.4 144/144] clk: kirkwood: Fix a clocking boot regression