usb: irda: cleanup on ir-usb module