ifed-ucsd

Results 4 issues of ifed-ucsd

Which evolution algorithm do you use?

I see two evolutionary algorithm implementations: one in ofa.tutorial.evolution_finder.py and one in ofa.nas.search_algorithm.evolution.py. Which one should I use and what is the difference? Thanks!

Running in AWS

6 comment

I tried running this codebase in AWS but encountered an issue with Pyro not working across several AWS instances (i.e. one instance running the dispatcher and many instances acting as...

Will you publish the code for the horseshoe prior?

What is the purpose of positional offset in the rotary positional embedding implementation?

I was looking at the rotational position embedding code path (https://github.com/lucidrains/recurrent-memory-transformer-pytorch/blob/35cd18deeb7965491873fcba4a15d581106eae39/recurrent_memory_transformer_pytorch/recurrent_memory_transformer.py#L414) and noticed this comment: # rotary embedding - offset main positions by 10000, and keep all memories at position...