USB: safe_serial: straighten out read processing