[PATCH 4.4 40/47] fb: fix lost console when the user unplugs a USB adapter