[PATCH 6.4 441/737] clk: qcom: gcc-qdu1000: Fix clkref clocks handling