[CRYPTO] api: Do not remove users unless new algorithm matches