idealboy

When I set actually_calculate_loss = True, I come accross the loss=nan Now I train 1000 classes (4110000 train samples with 200 epoch )with this code, and I found the inference...

How to use optimize_image.py

4

Dear Sir, How can I use the script optimize_image.py to process my Images? Thank you!

An Error when load the pretrained model?

7

when I load the pretrained model trained on ml-images(ckpt-resnet101-mlimages), an error occur as follow: KeyError: u'TfplusAllreduce my loaded code is: saver = tf.train.import_meta_graph("./pretrain_model/ckpt-resnet101-mlimages/model.ckpt.meta") saver.restore(sess, "./pretrain_model/ckpt-resnet101-mlimages") my tensorflow version is 1.10.0...

About the loss function?

2

Thank you for your explanation for the loss function, do you have any supplement material about the loss? I am curious about some code in the loss function, and I...

Train with multi gpus in one node？

6

sir, Can I train with multi gpus ? Just I modify the the code in train.py config.gpu_options.visible_device_list = str(FLAGS.train_gpus) # FLAGS.train_gpus='0,1,2,3,4,5,6,7' Does if affect the loss function computing or the...

where is the relu?

2

thank you!

could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR

1

Dear, when I run the train example , the problem occured like this: 2019-04-25 16:08:15.995839: E tensorflow/stream_executor/cuda/cuda_dnn.cc:359] could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2019-04-25 16:08:15.995915: E tensorflow/stream_executor/cuda/cuda_dnn.cc:326] could not destroy...

Add ability to model missing label?

1

Dear Sir, Does this code has support to model missing label in multi label trainning? Thank you very much!

how can I run the test across multi nodes？

4

I run the test_internode.py and test_low_latency on H20 (node_num=2, rank_num=16) What is the correct environment variable setting or what is the full script？ Only I set NCCL_IB_GID_INDEX=3, the test_internode.py can...