spi: spi_bfin, rearrange portmux calls