[PATCH stable v5.4] bnxt_en: Remove the setting of dev_port.