viafb: fix rmmod bug