question about splitTable in model/LSTM.lua

[YitzhakSp]

in model/LSTM.lua we have the following code sequence

local reshaped = nn.Reshape(4, rnn_size)(all_input_sums) local n1, n2, n3, n4 = nn.SplitTable(2)(reshaped):split(4)

my question is about the second line. if I understand correctly here the (4, rnn_size)-tensor is being split in 4 tensors. now SplitTable(2) means that the split goes along the second dimension. wouldn't it be more natural to split along the first dimension or am I missing something ?

[bearpaw]

@YitzhakSp I think the first dimension corresponds to the "batchsize".

[SJTUsuperxu]

@YitzhakSp @bearpaw yes, the first dim should correspond to the batch_size. Maybe when we call the lstm.lua in train, the model has been utilized automatically for parallel processing, which I mean the input size comes to batch_size * vocab_size