[PATCH 5.15 30/83] xfs: dont assert fail on perag references on teardown