bonding: fix panic when taking bond interface down before removing module