[PATCH 5.10 223/406] serial: sprd: Assign sprd_port after initialized to avoid wrong access