[PATCH 5.4 073/179] gpio: zynq: Fix wakeup source leaks on device unbind