"Dimension=-1 must be >= 0"

[zwy4896]

WARNING:tensorflow:From ./yolo/net/yolo_tiny_net.py:219: calling reduce_max (from tensorflow.python.ops.math_ops) with keep_dims is deprecated and will be removed in a future version. Instructions for updating: keep_dims is deprecated, use keepdims instead 2019-04-10 13:18:41.623793: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2019-04-10 13:18:41.764669: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1432] Found device 0 with properties: name: GeForce GTX 1080 major: 6 minor: 1 memoryClockRate(GHz): 1.86 pciBusID: 0000:05:00.0 totalMemory: 7.93GiB freeMemory: 7.65GiB 2019-04-10 13:18:41.879773: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1432] Found device 1 with properties: name: GeForce GTX 1080 major: 6 minor: 1 memoryClockRate(GHz): 1.86 pciBusID: 0000:09:00.0 totalMemory: 7.93GiB freeMemory: 7.65GiB 2019-04-10 13:18:41.879940: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1511] Adding visible gpu devices: 0, 1 2019-04-10 13:18:42.309734: I tensorflow/core/common_runtime/gpu/gpu_device.cc:982] Device interconnect StreamExecutor with strength 1 edge matrix: 2019-04-10 13:18:42.309770: I tensorflow/core/common_runtime/gpu/gpu_device.cc:988] 0 1 2019-04-10 13:18:42.309779: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1001] 0: N Y 2019-04-10 13:18:42.309793: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1001] 1: Y N 2019-04-10 13:18:42.310141: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1115] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7377 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:05:00.0, compute capability: 6.1) 2019-04-10 13:18:42.310442: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1115] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:1 with 7379 MB memory) -> physical GPU (device: 1, name: GeForce GTX 1080, pci bus id: 0000:09:00.0, compute capability: 6.1) 2019-04-10 13:19:10.197653: step 0, loss = 6.87 (1.2 examples/sec; 20.876 sec/batch) WARNING:tensorflow:******************************************************* WARNING:tensorflow:TensorFlow's V1 checkpoint format has been deprecated. WARNING:tensorflow:Consider switching to the more efficient V2 format: WARNING:tensorflow: tf.train.Saver(write_version=tf.train.SaverDef.V2) WARNING:tensorflow:now on by default. WARNING:tensorflow:******************************************************* 2019-04-10 13:19:17.826279: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at constant_op.cc:167 : Invalid argument: Dimension -1 must be >= 0 Traceback (most recent call last): File "tools/train.py", line 23, in solver.solve() File "./yolo/solver/yolo_solver.py", line 88, in solve _, loss_value, nilboy = sess.run([self.train_op, self.total_loss, self.nilboy], feed_dict={self.images: np_images, self.labels: np_labels, self.objects_num: np_objects_num}) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 929, in run run_metadata_ptr) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run feed_dict_tensor, options, run_metadata) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run run_metadata) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call raise type(e)(node_def, op, message) tensorflow.python.framework.errors_impl.InvalidArgumentError: Dimension -1 must be >= 0 [[node while_1/ones (defined at ./yolo/net/yolo_tiny_net.py:169) = Fill[T=DT_FLOAT, index_type=DT_INT32, _device="/job:localhost/replica:0/task:0/device:GPU:0"](while_1/Cast/_105, while_1/ones/Const)]] [[{{node gradients/AddN_144/_227}} = _Recvclient_terminated=false, recv_device="/job:localhost/replica:0/task:0/device:CPU:0", send_device="/job:localhost/replica:0/task:0/device:GPU:0", send_device_incarnation=1, tensor_name="edge_25564_gradients/AddN_144", tensor_type=DT_FLOAT, _device="/job:localhost/replica:0/task:0/device:CPU:0"]]

Caused by op u'while_1/ones', defined at: File "tools/train.py", line 22, in solver = eval(solver_params['name'])(dataset, net, common_params, solver_params) File "./yolo/solver/yolo_solver.py", line 32, in init self.construct_graph() File "./yolo/solver/yolo_solver.py", line 62, in construct_graph self.total_loss, self.nilboy = self.net.loss(self.predicts, self.labels, self.objects_num) File "./yolo/net/yolo_tiny_net.py", line 300, in loss tuple_results = tf.while_loop(self.cond1, self.body1, [tf.constant(0), object_num, [class_loss, object_loss, noobject_loss, coord_loss], predict, label, nilboy]) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/control_flow_ops.py", line 3291, in while_loop return_same_structure) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/control_flow_ops.py", line 3004, in BuildLoop pred, body, original_loop_vars, loop_vars, shape_invariants) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/control_flow_ops.py", line 2939, in _BuildLoop body_result = body(*packed_vars_for_body) File "./yolo/net/yolo_tiny_net.py", line 169, in body1 objects = tf.ones(temp, tf.float32) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/array_ops.py", line 1700, in ones output = fill(shape, constant(one, dtype=dtype), name=name) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/gen_array_ops.py", line 2979, in fill "Fill", dims=dims, value=value, name=name) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/op_def_library.py", line 787, in _apply_op_helper op_def=op_def) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/util/deprecation.py", line 488, in new_func return func(*args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/ops.py", line 3274, in create_op op_def=op_def) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/ops.py", line 1770, in init self._traceback = tf_stack.extract_stack()

InvalidArgumentError (see above for traceback): Dimension -1 must be >= 0 [[node while_1/ones (defined at ./yolo/net/yolo_tiny_net.py:169) = Fill[T=DT_FLOAT, index_type=DT_INT32, _device="/job:localhost/replica:0/task:0/device:GPU:0"](while_1/Cast/_105, while_1/ones/Const)]] [[{{node gradients/AddN_144/_227}} = _Recvclient_terminated=false, recv_device="/job:localhost/replica:0/task:0/device:CPU:0", send_device="/job:localhost/replica:0/task:0/device:GPU:0", send_device_incarnation=1, tensor_name="edge_25564_gradients/AddN_144", tensor_type=DT_FLOAT, _device="/job:localhost/replica:0/task:0/device:CPU:0"]]