deep-vector-quantization icon indicating copy to clipboard operation
deep-vector-quantization copied to clipboard

VQVAEs, GumbelSoftmaxes and friends

Results 4 deep-vector-quantization issues
Sort by recently updated
recently updated
newest added

Hey Andrej! Cool repo :+1: This is a small change that effectually computes `model(x - 0.5)` in `visualize.ipynb`. Otherwise `model(x) - 0.5` looks like this ![before_mv_inmap](https://user-images.githubusercontent.com/181225/121820145-ffb82500-cc45-11eb-96a1-e22abcd7a0d4.png) After the change we...

#========== ` def forward(self, z): B, C, H, W = z.size() z_e = self.proj(z) z_e = z_e.permute(0, 2, 3, 1) # make (B, H, W, C) flatten = z_e.reshape(-1, self.embedding_dim)...

From my understanding, the input of `F.gumbel_softmax` (i.e., the` logits` parameter) should be the \log of a discrete distribution. However, I didn't see any softmax or log_softmax before the gumbel_softmax....

I believe that there is at least one 1x1 conv missing. In the paper on p. 3 they mention the crucial importance of those but I could only find a...