If the cpu offload ratio changes, do torch compile again?

[m8rr]

Custom Node Testing

• [ ] I have tried disabling custom nodes and the issue persists (see how to disable custom nodes if you need help)

Your question

ratio changes for each run and a lot of time is spent on compilation. probably seems normal, but is there any way to improve it?

Requested to load WAN21
loaded partially; 8163.12 MB usable, 8163.12 MB loaded, 1342.18 MB offloaded, lowvram patches: 0
100%|████████████████████████████████████████████████████████████████████████████████████| 2/2 [02:57<00:00, 88.77s/it]
Requested to load WanVAE
loaded completely; 270.18 MB usable, 242.03 MB loaded, full load: True
Prompt executed in 237.19 seconds
got prompt
loaded partially; 8120.12 MB usable, 8120.12 MB loaded, 1385.18 MB offloaded, lowvram patches: 0
100%|████████████████████████████████████████████████████████████████████████████████████| 2/2 [06:11<00:00, 185.62s/it]
Requested to load WanVAE
loaded completely; 278.26 MB usable, 242.03 MB loaded, full load: True
Prompt executed in 376.35 seconds
got prompt
loaded partially; 8120.12 MB usable, 8120.11 MB loaded, 1385.19 MB offloaded, lowvram patches: 0
100%|████████████████████████████████████████████████████████████████████████████████████| 2/2 [03:00<00:00, 90.34s/it]
Requested to load WanVAE
loaded completely; 276.26 MB usable, 242.03 MB loaded, full load: True
Prompt executed in 186.48 seconds
got prompt
loaded partially; 8118.12 MB usable, 8111.17 MB loaded, 1394.12 MB offloaded, lowvram patches: 0
100%|████████████████████████████████████████████████████████████████████████████████████| 2/2 [03:01<00:00, 90.76s/it]
Requested to load WanVAE
loaded completely; 276.26 MB usable, 242.03 MB loaded, full load: True
Prompt executed in 187.43 seconds
got prompt
loaded partially; 8118.12 MB usable, 8111.17 MB loaded, 1394.12 MB offloaded, lowvram patches: 0
100%|████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:08<00:00,  4.49s/it]
Requested to load WanVAE
loaded completely; 359.20 MB usable, 242.03 MB loaded, full load: True
Prompt executed in 14.16 seconds
got prompt
loaded partially; 8118.12 MB usable, 8111.17 MB loaded, 1394.12 MB offloaded, lowvram patches: 0
100%|████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:08<00:00,  4.48s/it]
Requested to load WanVAE
loaded completely; 359.20 MB usable, 242.03 MB loaded, full load: True
Prompt executed in 13.82 seconds

Logs

Other

No response

[github-actions[bot]]

This issue is being marked stale because it has not had any activity for 30 days. Reply below within 7 days if your issue still isn't solved, and it will be left open. Otherwise, the issue will be closed automatically.