[PATCH 5.10 128/294] usb: port: Dont try to peer unused USB ports based on location