[PATCH 5.4 012/367] serial: sc16is7xx: fix bug when first setting GPIO direction