Can Balioglu
Can Balioglu
fairseq v2
# fairseq v2 Hi everyone, We wanted to let you know that FAIR will soon kick off the fairseq v2 project in order to modernize our code base and to...
## 🚀 Feature TorchStore is a key-value store that holds ATen tensors in shared memory so that they can be accessed across process boundaries without any expensive copy operations. ##...
As the second recipe after NLLB, write the w2v-BERT (and wav2vec2) pretraining recipe for users to check out. This will likely branch to several subtasks once we start working on...
Introduce Megatron style model parallelism.
When multiple processes in a distributed job attempt to download the same asset, we do not handle it in a race-free way if the file system is shared. Think of...
Introduce support for StreamingLLM (https://arxiv.org/abs/2309.17453) for model exploration tasks.
Start using iwyu (include-what-you-use) in libfairseq2.
In libfairseq2 we have pretty good error reporting, but the same can't be said for logging. Introduce logging in C++ and figure out a way to integrate it with Python...
Right now we can't run our tests on GPU machines in GitHub Actions since there is still no support for them. Update our workflow files once the support is available.
Introduce support for sequence parallelism.