[PATCH 4.4 68/72] Revert "cpufreq: Fix governor module removal race"