[PATCH 5.4 170/184] media: staging/intel-ipu3: Fix set_fmt error handling