OMAP4: Remove the secondary wait loop