[PATCH v4 2/2] usb: gadget: udc: core: Prevent redundant calls to pullup