[PATCH 5.4 163/168] Revert "serial: uartps: Move Port ID to device data structure"