KVM: Move device assignment logic to common code