DNC-tensorflow icon indicating copy to clipboard operation
DNC-tensorflow copied to clipboard

A TensorFlow implementation of DeepMind's Differential Neural Computers (DNC)

Results 17 DNC-tensorflow issues
Sort by recently updated
recently updated
newest added

### Common Settings The model is trained on 2-layer feedforward controller (with hidden sizes 128 and 256 respectively) with the following set of hyperparameters: - RMSProp Optimizer with learning rate...

in-progress

Hi, I am training the network on NVIDIA Tesla GPU with a batch size of 1. I am training for 500K iterations, it's taking huge time, around some 600 hours....

I successfully run the program.However, I found threre is something seen abnormal. class RecurrentController(BaseController): def network_vars(self): self.lstm_cell = tf.nn.rnn_cell.BasicLSTMCell(256) self.state = self.lstm_cell.zero_state(self.batch_size, tf.float32) def network_op(self, X, state): X = tf.convert_to_tensor(X)...

I am trying to fallow Project Structure and Usage but complete running examples would help I ran the code with no output to Initial Transformation Weights that I skipped the...

Hello. This is a very good code. But I am very curious about why use FeedforwardController instead of the original BaseController. Is there small specific function?

python tasks/copy/train.py --iterations=50000 Building Computational Graph ... Traceback (most recent call last): File "tasks/copy/train.py", line 82, in batch_size File "/Users/yike.ke/yike_prj/DNC-tensorflow/tasks/copy/dnc/dnc.py", line 46, in __init__ self.controller = controller_class(self.input_size, self.output_size, self.read_heads, self.word_size,...

Hello, The output sequence length in the implementation is the same as the input sequence length. Perhaps I have misunderstood, but is this a required feature? In the BaBi task...

hi there is it possible for you point me out some resorces to include externals embeddings from word2vec?, in order to transfer some learnign from a particular field in the...

Hey guys! Thanks a lot for sharing this! I switched to TF 1.0 and upgrading your code is not entirely straightforward (the upgrade script leaves several places to be dealt...

Imports, prints were fixed. All test were passed. Test tasks work as expected. Tested with python 3.5.2.