[PATCH 6.1 127/208] ASoC: SOF: sof-audio: unprepare when swidget->use_count > 0