[PATCH 5.15 056/691] soundwire: stream: Revert "soundwire: stream: fix programming slave ports for non-continous port maps"