Robert McMenemy
Robert McMenemy
This works as a fix for cursor ` let allNFTs = []; const timer = (ms) => new Promise((res) => setTimeout(res, ms)); let cursor = null; do { const NFTs...
> not sure if I wanna screw anything up, at the moment I run it with certain parameters, which my 8gb seems to handle. Problem is I can't seem to...
My bad good spot graham will undo with a new commit
This may be linked to issue #27
Good spot yet again @dancergraham have switched over to nvidia apex for fusedlayernorm on GPU can you try this now ?
NB this requires the external lib for apex to work should speed up rendering once it fires up. Any issues let me know and I'll rework @dancergraham (have added to...
Looking into other alternatives to layernorm and it seems instance or group normalisation may help speed things up here ! Will ping another refactored PR soon
Shall remove the apex lib but keep the forward pass change this should still preserve performance without the lib dependency
@dancergraham try this now, textvec rendering should still be significantly faster whilst I find a native way of speeding up layer norm on gpu / cuda
My bad @dancergraham forgot I added as a param, changed back so .to() uses torch.deice directly rather than by reference from param list