[PATCH] ALSA: usb-audio: Don't refcount multiple accesses on the single clock