[PATCH 5.10 479/509] iavf: Fix out-of-bounds when setting channels on remove