[PATCH v3 1/2] secretmem/gup: don't check if page is secretmem without reference