rstrudel
rstrudel
You could probably replace ViT with a swin encoder indeed :) You could get improved performance given the downstream performances of Swin that are better than ViT on some tasks.
You can check the code related to https://arxiv.org/abs/2103.13413 , they trained with adam and give details in the paper. Adam is much more agressive - so low learning rates should...
It does work for fish too. I have a similar setup: - install `fish` from conda-forge - to get the module command `source /gpfslocalsup/spack_soft/environment-modules/current/init/fish` - add `exec $PATH_TO_CONDA_ENVS/bin/fish -l` to...
The command `rsync -avz ~/folder-to-sync jean-zay:~/folder-to-sync --delete` may be slow when the folder you want to update contains many small files. This command is nice but does not scale well...
FYI #75 add automatic sync to the set of tips.
@Werejoice any chance you could share what went wrong and how you solved it ? I did not encounter this problem. Thanks