d4nst
terminate called without an active exception
Epoch 1/10 1/78 [..............................] - ETA: 18:04 - loss: 6.8646 - angle_error: 52.20002020-11-05 14:41:31.189663: I tensorflow/core/profiler/lib/profiler_session.cc:184] Profiler session started. 79/78 [==============================] - 75s 944ms/step - loss: 26.7035 - angle_error: 92.1519 - val_loss: 44509464.0000 - val_angle_error: 86.4056 Epoch 2/10 79/78 [==============================] - 61s 771ms/step - loss: 5.9489 - angle_error: 85.8304 - val_loss: 2772.1135 - val_angle_error: 91.6222 Epoch 3/10 79/78 [==============================] - 61s 776ms/step - loss: 5.9423 - angle_error: 86.7544 - val_loss: 100.6272 - val_angle_error: 99.2500 Epoch 4/10 79/78 [==============================] - 62s 781ms/step - loss: 5.9029 - angle_error: 90.5772 - val_loss: 15.7331 - val_angle_error: 91.6167 Epoch 5/10 79/78 [==============================] - 62s 781ms/step - loss: 5.9086 - angle_error: 90.0785 - val_loss: 5.8849 - val_angle_error: 85.2556 Epoch 6/10 79/78 [==============================] - 60s 757ms/step - loss: 5.8797 - angle_error: 86.2304 - val_loss: 5.7751 - val_angle_error: 88.5000 Epoch 7/10 79/78 [==============================] - 60s 765ms/step - loss: 5.8956 - angle_error: 87.9089 - val_loss: 5.8789 - val_angle_error: 84.8389 Epoch 8/10 79/78 [==============================] - 60s 758ms/step - loss: 5.8876 - angle_error: 90.5392 - val_loss: 5.8946 - val_angle_error: 92.6167 Epoch 9/10 79/78 [==============================] - 61s 771ms/step - loss: 5.8850 - angle_error: 88.1291 - val_loss: 5.9170 - val_angle_error: 93.7278 Epoch 10/10 79/78 [==============================] - 61s 768ms/step - loss: 5.8809 - angle_error: 88.1139 - val_loss: 5.8692 - val_angle_error: 84.4833 terminate called without an active exception terminate called recursively terminate called recursively terminate called recursively Aborted (core dumped)
Package Version
absl-py 0.8.0 astor 0.8.0 certifi 2020.6.20 cycler 0.10.0 gast 0.2.2 google-pasta 0.1.7 grpcio 1.24.0 h5py 2.10.0 Keras 2.3.0 Keras-Applications 1.0.8 Keras-Preprocessing 1.1.0 kiwisolver 1.1.0 Markdown 3.1.1 matplotlib 3.1.1 numpy 1.17.2 opencv-python 4.4.0.46 opt-einsum 3.1.0 pip 20.2.4 protobuf 3.9.2 pyparsing 2.4.2 python-dateutil 2.8.0 PyYAML 5.1.2 scipy 1.5.4 setuptools 50.3.0.post20201103 six 1.12.0 tensorboard 2.0.0 tensorflow 2.0.0 tensorflow-estimator 2.0.0 termcolor 1.1.0 Werkzeug 0.16.0 wget 3.2 wheel 0.35.1 wrapt 1.11.2
Were you ever able to solve this problem @nouraIT ? I'm having the same issue now and it seems like its likely something under the hood with Keras or the workers in C++
