[PATCH 5.15 170/279] remoteproc: qcom_q6v5_pas: Make single-PD handling more robust