adebiasio-estilos

I'm interested in early stopping and saving best model automatically too for hyperparameters tuning! Have you found a way (or at least a starting point) to implement these functionalities in...

By modifying the library and setting ``` os.environ['PYTHONHASHSEED']=str(self.seed) random.seed(self.seed) np.random.seed(self.seed) tf.set_random_seed(self.seed) torch.manual_seed(self.seed) ``` into the build_model() function is a bit better for SVD but the behavior of NCF is strange....

Hi, first of all thanks for answering and for your great work with the library! I added also ``` os.environ['PYTHONHASHSEED']=str(seed) random.seed(seed) np.random.seed(seed) tf.set_random_seed(seed) torch.manual_seed(seed) ``` prior all the code. SVD...

I tried with shuffle=False but the results are still strange.. I created a jupyter notebook for reference that may help. If you execute it, you still get reproducible results? [Test.zip](https://github.com/massquantity/LibRecommender/files/12206865/Test.zip)

Uhmm, I actually tried but I still get the previous results with NCF. Btw, don't know if you made some recent updates to the library, I downloaded the version of...

So, I made a test also with the last commit and the versions of the libraries you put in the previous commit but I still get strange results with NCF...

You are right, with only CPUs (i.e., setting `os.environ["CUDA_VISIBLE_DEVICES"] = "-1"` ) it works  But what may happen when using GPUs then?

So, I actually tried setting: ``` random.seed(42) np.random.seed(42) #tf.random.set_seed(42) # 'tensorflow.compat.v1.random' has no attribute 'set_seed' #tf.experimental.numpy.random.seed(42) # 'tensorflow.compat.v1.experimental' has no attribute 'numpy' tf.set_random_seed(42) # 'tensorflow' has no attribute 'set_random_seed' os.environ['TF_CUDNN_DETERMINISTIC']...

So, I actually put: ``` import random import numpy as np import torch import os import tensorflow as tf2 from libreco.tfops import tf random.seed(42) np.random.seed(42) torch.manual_seed(42) torch.cuda.manual_seed(42) torch.backends.cudnn.deterministic = True...

Ok.. So I also added: ``` os.environ["CUDA_VISIBLE_DEVICES"] = "0" os.environ["TF_CUDNN_USE_AUTOTUNE"] = "0" ``` as per chatgpt suggestion. But still get struggle with NCF unfortunately :(