Venkat Krishnan

Help with make error

3

Hello, I am a novice and need help with an error I get when compiling cvdrone in lubuntu 14.0.3LTS. The OS came with opencv 2.4.8 but I downloaded opencv 3.1...

Checkpointing is not compatible with .grad() or when an `inputs` parameter is passed to .backward()

1

https://github.com/lucidrains/memory-efficient-attention-pytorch/blob/35559a05572f9d4eb982a8e2e399b40a2d61b85c/memory_efficient_attention_pytorch/memory_efficient_attention.py#L95 Should this be: `summarize_qkv_fn = summarize_qkv_chunk if needs_backwards else checkpointed_summarize_qkv_chunk` instead of: `summarize_qkv_fn = checkpointed_summarize_qkv_chunk if needs_backwards else summarize_qkv_chunk`

Seed not giving reproducibility

9

Hi, I am running this on AWS on a ubuntu machine with the A10G processor. I am setting the seed to 96576 using the --seed parameter, but when I run...

How much memory does this take for text_enc + unet with prior preservation?

3

How much memory does this take for text_enc + unet with prior preservation? Can it fit in 16 GB with 8 bit adam and fp16?