ifed-ucsd
ifed-ucsd
I see two evolutionary algorithm implementations: one in ofa.tutorial.evolution_finder.py and one in ofa.nas.search_algorithm.evolution.py. Which one should I use and what is the difference? Thanks!
I tried running this codebase in AWS but encountered an issue with Pyro not working across several AWS instances (i.e. one instance running the dispatcher and many instances acting as...
I was looking at the rotational position embedding code path (https://github.com/lucidrains/recurrent-memory-transformer-pytorch/blob/35cd18deeb7965491873fcba4a15d581106eae39/recurrent_memory_transformer_pytorch/recurrent_memory_transformer.py#L414) and noticed this comment: # rotary embedding - offset main positions by 10000, and keep all memories at position...