[PATCH 6.1 425/600] serial: sprd: Assign sprd_port after initialized to avoid wrong access